Quick overview
SeniorityLeader
Work modeHybrid
LocationNoida, India
SQLGitApache SparkETLSnowflakeDatabricksGitHub ActionsJenkinsPythonAzureProject ManagementCI/CDAzure DevOpsAzure Data Factory
Job description
Role Title: Azure Data Engineer
BU/Segment: Healthcare Analytics
Responsibilities
- Design, develop, test, and deploy robust and scalable data pipelines using Azure Databricks, PySpark, and Spark SQL for processing large volumes of structured and unstructured data.
- Implement workflow orchestration using Azure Data Factory and Databricks Workflows to automate ETL/ELT processes.
- Implement and maintain CI/CD pipelines for Databricks notebooks, scripts, and configurations using Azure DevOps or GitHub Actions, promoting code across dev, test, and prod environments.
- Develop and maintain healthcare data models, including data entities, relationships, and data flows, to support healthcare analytics and decision-making.
- Design and implement enterprise-wide BI architectures. Develop and maintain data warehouses and data marts.
- Develop and maintain reports, dashboards, and data visualizations. Collaborate with stakeholders to understand business needs and provide data-driven insights
Person attributes
- 6+ years of experience as a Data Engineer with a proven track record of building data pipelines in the cloud.
- 3+ years of hands-on experience with Azure Databricks
- Strong experience with core Azure data services – Azure Data Lake Storage (Gen 2), Azure data factory.
- Proficiency in Python and expert-level skills in SQL
- Solid understanding of data warehousing concepts, dimensional modeling (star/snowflake schemas), and data architecture principles
- Experience with CI/CD pipelines (Azure DevOps, Jenkins, GitHub Actions) and version control systems (Git).
- Demonstrated experience and knowledge of strategic problem solving and frameworks, and project management skills
- Excellent written and verbal communication with the ability to establish credibility and strong relationships with stakeholders
Role Title: Azure Data Engineer
BU/Segment: Healthcare Analytics
Responsibilities
- Design, develop, test, and deploy robust and scalable data pipelines using Azure Databricks, PySpark, and Spark SQL for processing large volumes of structured and unstructured data.
- Implement workflow orchestration using Azure Data Factory and Databricks Workflows to automate ETL/ELT processes.
- Implement and maintain CI/CD pipelines for Databricks notebooks, scripts, and configurations using Azure DevOps or GitHub Actions, promoting code across dev, test, and prod environments.
- Develop and maintain healthcare data models, including data entities, relationships, and data flows, to support healthcare analytics and decision-making.
- Design and implement enterprise-wide BI architectures. Develop and maintain data warehouses and data marts.
- Develop and maintain reports, dashboards, and data visualizations. Collaborate with stakeholders to understand business needs and provide data-driven insights
Person attributes
- 6+ years of experience as a Data Engineer with a proven track record of building data pipelines in the cloud.
- 3+ years of hands-on experience with Azure Databricks
- Strong experience with core Azure data services – Azure Data Lake Storage (Gen 2), Azure data factory.
- Proficiency in Python and expert-level skills in SQL
- Solid understanding of data warehousing concepts, dimensional modeling (star/snowflake schemas), and data architecture principles
- Experience with CI/CD pipelines (Azure DevOps, Jenkins, GitHub Actions) and version control systems (Git).
- Demonstrated experience and knowledge of strategic problem solving and frameworks, and project management skills
- Excellent written and verbal communication with the ability to establish credibility and strong relationships with stakeholders
Role Title: Azure Data Engineer
BU/Segment: Healthcare Analytics
Responsibilities
- Design, develop, test, and deploy robust and scalable data pipelines using Azure Databricks, PySpark, and Spark SQL for processing large volumes of structured and unstructured data.
- Implement workflow orchestration using Azure Data Factory and Databricks Workflows to automate ETL/ELT processes.
- Implement and maintain CI/CD pipelines for Databricks notebooks, scripts, and configurations using Azure DevOps or GitHub Actions, promoting code across dev, test, and prod environments.
- Develop and maintain healthcare data models, including data entities, relationships, and data flows, to support healthcare analytics and decision-making.
- Design and implement enterprise-wide BI architectures. Develop and maintain data warehouses and data marts.
- Develop and maintain reports, dashboards, and data visualizations. Collaborate with stakeholders to understand business needs and provide data-driven insights
Person attributes
- 6+ years of experience as a Data Engineer with a proven track record of building data pipelines in the cloud.
- 3+ years of hands-on experience with Azure Databricks
- Strong experience with core Azure data services – Azure Data Lake Storage (Gen 2), Azure data factory.
- Proficiency in Python and expert-level skills in SQL
- Solid understanding of data warehousing concepts, dimensional modeling (star/snowflake schemas), and data architecture principles
- Experience with CI/CD pipelines (Azure DevOps, Jenkins, GitHub Actions) and version control systems (Git).
- Demonstrated experience and knowledge of strategic problem solving and frameworks, and project management skills
- Excellent written and verbal communication with the ability to establish credibility and strong relationships with stakeholders
Similar jobs
- CH
Associate - OnboardingRecently posted
Clean Harbors · Bengaluru · Hybrid 🇮🇳
OnboardingMicrosoft ExcelMicrosoft Office+1Salary not listed - CH
Senior associate - AR collections
Clean Harbors · Hyderabad · Hybrid 🇮🇳
General LedgerProcurementSalary not listed - CH
Associate BDR
Clean Harbors · Pune · Hybrid 🇮🇳
CRMInside SalesOutreach+5Salary not listed - CH
Associate CHES
Clean Harbors · Bengaluru · Hybrid 🇮🇳
Stakeholder ManagementCRMProcurement+3Salary not listed - CH
Customer Engagement Manager
Clean Harbors · Hyderabad · Hybrid 🇮🇳
Microsoft OfficeProcurementRoot Cause Analysis+1Salary not listed - CH
Associate Govt Contract Mgmt
Clean Harbors · Pune · Hybrid 🇮🇳
Stakeholder ManagementAccount ManagementDocument Management+2Salary not listed - CH
Sr Jira Admin
Clean Harbors · Hyderabad · Hybrid 🇮🇳
ProcurementSalary not listed - CH
Manager CMD
Clean Harbors · Hyderabad · Hybrid 🇮🇳
Stakeholder ManagementSQLMicrosoft Excel+10Salary not listed - CH
Lead / AM - Taxation
Clean Harbors · Hyderabad · Hybrid 🇮🇳
Microsoft ExcelMicrosoft PowerPointCompliance+3Salary not listed - CH
Manager - Onboarding
Clean Harbors · Bengaluru · Hybrid 🇮🇳
OnboardingComplianceContinuous Improvement+4Salary not listed - CH
Manager/Senior Manager - Trans Compliance (Operations)
Clean Harbors · Hyderabad · Hybrid 🇮🇳
Stakeholder ManagementOnboardingMicrosoft Office+4Salary not listed - CH
Associate - Taxation
Clean Harbors · Hyderabad · Hybrid 🇮🇳
Microsoft ExcelMicrosoft OfficeMicrosoft PowerPoint+3Salary not listed
