Lead Azure Data Engineer

Lead Azure Data Engineer
Experience: 10–12 Years
Location: New Jersey
Work Arrangement: Hybrid – Minimum 2 Days Onsite per Week
 

Relevant Azure Data Lead Experience: 5+ Years

Mandatory Technical Skills

• Azure Databricks
• Azure Data Factory (ADF)
• Azure Data Architecture
• PySpark
• SQL
• Mandatory Azure Architect Certification

Role Overview

We are looking for an experienced Lead Azure Data Engineer with strong expertise in designing and architecting enterprise-scale solutions on the Azure Data Platform. The ideal candidate should have hands-on experience with Azure Databricks, ADF, PySpark, data lakes, data warehouses, and modern data architecture.

Key Responsibilities & Requirements

• 5+ years of experience as an Azure Data Engineer.
• 7+ years of overall experience working on the Azure Data Platform.
• Design and architect scalable, secure, and highly available Azure data solutions.
• Strong experience with Azure Databricks and PySpark.
• Experience integrating multiple data sources with Data Warehouses and Data Lakes.
• Design and implement data lakes and data warehouses supporting Reporting, AI, and Machine Learning initiatives.
• Strong understanding of data modeling and data architecture concepts.
• Knowledge and understanding of Unity Catalog.
• Knowledge of Azure Cloud Security, governance, and best practices.
• Understanding of Data Mesh is a plus.
• Good understanding of Microsoft Fabric and Copilot.
• Evaluate technology options and clearly communicate their pros and cons.
• Collaborate with clients to understand business requirements and translate them into technical Azure solutions.
• Identify and implement automation opportunities to improve operational efficiency.
• Conduct knowledge-sharing and training sessions for clients and internal teams.
• Experience with estimation and solution design on Azure Cloud.
• Life Sciences domain experience — Healthcare, Pharma, Med-Tech, Medical Devices, or Manufacturing — is a plus.