Quick overview
Job description
- Build and maintain bronze, silver, and gold lakehouse layers in Microsoft Fabric and Databricks.
- Develop ingestion and transformation pipelines using notebooks and PySpark.
- Implement incremental loading and change data capture (CDC) from on‑prem SQL to Fabric/Databricks.
- Optimize Delta tables for performance and cost efficiency.
- Create and sustain Azure Data Factory pipelines and Azure Analysis Services cubes.
- Own data products as managed assets: version control, testing, monitoring, and continuous improvement.
- Ensure datasets comply with defined data contracts, governance, and platform standards.
- Collaborate with business stakeholders, analysts, and the central Data Platform team.
- Design and optimize semantic models for enterprise analytics platforms such as Power BI.
- Mentor junior engineers and champion architectural standards and modern technologies.
- 6+ years of hands‑on data engineering experience in SQL‑heavy or enterprise data environments.
- Deep expertise in Microsoft SQL Server and advanced T‑SQL development, including query optimization.
- Practical experience with Microsoft Fabric, Lakehouse architecture, and Delta Lake.
- Proficiency in Spark (PySpark preferred) and Python notebooks for distributed data transformation.
- Experience with Azure Data Factory, Databricks, Azure Analysis Services, ADLS Gen2, and Purview.
- Strong knowledge of dimensional modeling (Kimball) and semantic model design for Power BI.
- Proven ability to implement incremental loading and CDC patterns in hybrid environments.
- Familiarity with CI/CD pipelines, testing frameworks, monitoring, and data governance principles.
- Background in financial services, banking, or capital markets.
- Microsoft certifications (Azure Data Engineer, Fabric) and excellent facilitation, presentation, and influencing skills.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- SW

Structured Data Engineer - AI Search (Remote, Full-Time) [HR226]Recently posted Auto Apply
Smart Working Solutions · India · Remote · Posted 18 Nov 2026 🇮🇳
SQLGitHTML+7TechnologySalary not listed - BM

AI Data Engineer (Speech & Language)Recently posted Auto Apply
Blue Machines AI · Bengaluru, Karnataka · On-site · Posted 19 Nov 2026 🇮🇳
GitNLPBash+6TechnologySalary not listed - CA

Snowflake Data EngineerRecently posted Auto Apply
Capco · Bengaluru · Hybrid · Posted 19 Nov 2026 🇮🇳
SQLGitETL+13TechnologySalary not listed - WP

Data EngineerRecently posted Auto Apply
WPP · Chennai · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLApache SparkDatabricks+9TechnologySalary not listed - JU

Data Engineer - II (Biometrics)Recently posted Auto Apply
Jumio · Bengaluru · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLAWSETL+5TechnologySalary not listed - CH

Senior Data EngineerRecently posted Auto Apply
Cohere Health · Hyderabad · Hybrid · Posted 17 Nov 2026 🇮🇳
SQLApache SparkAWS+6TechnologySalary not listed - B2
Senior Fabric Lead Data Engineer - R01572945 Auto Apply
Brillio 2 · Bengaluru · Hybrid · Posted 22 Oct 2026 🇮🇳
SQLGitApache Spark+6TechnologySalary not listed - WE
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekdayworks · Bengaluru · On-site · Posted 16 Nov 2026 🇮🇳
Technology₹1400k - ₹2000k/yr - V1
Senior Oracle Fusion Data Migration ConsultantRecently posted Auto Apply
Version 1 · Bengaluru, KA · Hybrid · Posted 16 Nov 2026 🇮🇳
OraclePL/SQLSQL+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Chennai, Tamil Nadu · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Hyderabad, Telangana · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Pune, Maharashtra · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed