Quick overview
SeniorityMid Senior
Work modeHybrid
LocationPune, India
ETLComplianceDatabricksAzureCI/CDAzure DevOpsDelta Lake
Job description
Zensar Technologies Limited is seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Azure, Delta Lake, and Spark. In this role you will architect end‑to‑end data solutions, develop robust data pipelines, and enable data‑driven decision‑making across the organization while adhering to modern data engineering best practices.
- Design and implement scalable data architectures on Azure using Databricks, Delta Lake, and Spark.
- Develop, test, and maintain ETL/ELT pipelines that ingest and transform large volumes of data.
- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions.
- Optimize performance and cost of data workloads through tuning, caching, and resource management.
- Implement data governance, security, and compliance controls in line with enterprise standards.
- Automate deployment and monitoring of data pipelines using CI/CD tools and Azure DevOps.
- Create and maintain comprehensive documentation for data models, pipelines, and processes.
- Mentor junior engineers and promote best practices in data engineering and cloud services.
- Evaluate emerging technologies and recommend enhancements to the data platform.
- Troubleshoot and resolve production issues, ensuring high availability and reliability.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works