Quick Overview
Job Description
Experience : 8–10 years overall, with 3+ years of Azure experience.
Required Skills
Strong hands-on experience with Azure Data Factory (ADF) — pipelines, data flows, triggers, integration runtimes, parameterization, error handling, and retries. Strong experience with Azure Databricks — Notebooks, Jobs/Workflows, PySpark/Scala, Delta Lake, cluster configuration, and optimization. Advanced Python or Scala with strong coding standards, modularization, and unit testing (pytest). Expert SQL — CTEs, window functions, query tuning, and large datasets. Experience with ADLS Gen2, Delta Lake, Parquet, partitioning, Z-Ordering, OPTIMIZE, and VACUUM.
Experience with Git, branching strategies, and CI/CD for ADF/Databricks. Exposure to Infrastructure as Code (IaC) is a plus. Roles and Responsibilities
Coding & Development: Design, develop, and optimize ADF/Databricks data pipelines and solutions.
UI Testing: Perform functional/UI testing, data validation, and troubleshooting.
Stakeholder Management: Collaborate with stakeholders, understand requirements, and communicate project status/issues effectively.
Skills
Similar jobs
AEM UI / Design System Lead
Kainos Innovative Solutions Inc · Plainsboro Township, United States
1 minute agoEUC and Alteryx Solutions
Cyber Sphere LLC · McLean, United States
1 minute agoNeed Locals - Portfolio & Resource Manager
Amtex System Inc. · Rockleigh, United States
1 minute agoPeoplesoft
OVS Technologies Inc · Richmond, United States
1 minute agoApptio administrator
Prudent Technologies and Consulting · United States
7 minutes agoPrincipal Clinical Information Analyst
Arnex Solutions LLC · Maple Grove, United States
7 minutes ago