Role: Azure Data Engineer Lead

Introduction: The Azure Data Engineer Lead will be responsible for designing and setting up Azure Data Factory (ADF) and Microsoft Fabric for data pipelines, Lakehouse, and Warehouse. They will work with PySpark for data transformation, data modelling, ETL/ELT processes, data governance, performance tuning, security configurations, and cloud migration projects. The ideal candidate will have knowledge of predictive analytics, data quality frameworks, automation testing, and experience in designing facts and dimension data modelling in finance and HR domains such as D365 and Workday.

Responsibilities:

• Design and set up Azure Data Factory and Microsoft Fabric for data pipelines, Lakehouse, and Warehouse.
• Utilize PySpark for data transformation techniques.
• Implement data modelling, ETL/ELT processes, and data governance best practices.
• Optimize performance tuning, security configurations, and environment setup.
• Lead cloud migration projects from Azure to Fabric or similar platforms.
• Apply knowledge of predictive analytics, data quality frameworks, and automation testing.
• Design facts and dimension data modelling for finance and HR domains like D365 and Workday.

Requirements:

Required Skills: ADF, Automated Testing, Cloud Computing, Data Governance, Data Modeling, Data Quality, ELT, Extract, Transform, Load, Microsoft, Microsoft Azure, Migration, Performance Tuning, Predictive Analytics, PySpark, Warehouse, Workday.

Preferred Skills: Experience in finance and HR domains, familiarity with D365 and Workday.