Senior Data Engineer

Adobe is hiring a Senior Data Engineer in Bangalore.

We are seeking a Senior Data Engineer to operate & design, manage & maintain, and optimize our data platform. In this role, you will bridge the gap between traditional big data engineering and modern Generative AI infrastructure. You will be responsible for building robust data pipelines on Databricks, engineering high-quality datasets for AI models, and implementing retrieval architectures.

Responsibilities

• Data Architecture: Design scalable distributed data processing systems.
• Pipeline Development: Build ETL/ELT pipelines for complex datasets.
• AI Integration: Implement and fine-tune generative AI capabilities.
• App Engineering: Develop backend services to expose data products.
• System Optimization: Improve code performance, data quality, and storage efficiency.
• Mentorship: Guide junior engineers and advocate for technical best practices.

Required Technical Skills Primary Expertise (Expert Level)

• Data Engineering: Apache Spark, Hadoop, Kafka, and Databricks/Delta Lake.
• Python Ecosystem: PySpark, Pandas, NumPy, and performance tuning.
• Cloud Platforms: Advanced deployment experience within AWS or Azure.
• Data Modeling: Expert knowledge of relational and non-relational databases.

Secondary Expertise (Intermediate Level)

• GenAI / LLMs: Experience with LangChain, LlamaIndex, and vector databases (e.g., Pinecone, Milvus).
• Application Engineering: Building APIs using FastAPI, Flask, or Node.js.
• DevOps / MLOps: Containerization via Docker, Kubernetes, and CI/CD deployment workflows.

Requirements

• Education: Bachelor's degree in Computer Science or a related field.
• Experience: 7+ years of professional software engineering experience.
• Portfolio: Proven track record of shipping production-grade data pipelines.

About Adobe

Adobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe’s industry-leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, and GenStudio enable people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity. Our 30,000+ employees worldwide are creating the future and raising t