Lead Data Engineer Databricks

Lead Data Engineer – Databricks
Location: Bay Area, CA / Remote – Local or Nearby Candidates Only
Experience: 12+ Years

Domain: Healthcare – Mandatory
 

Work Authorization: USC / H4 EAD / GC EAD / L2S / H1B

Mandatory Skills:

• Databricks, Delta Lake, Apache Spark/PySpark, Python, SQL, Healthcar

Job Description:

We are looking for a Lead Data Engineer with Databricks expertise to design, develop, and optimize scalable data engineering solutions in the Healthcare domain

Required:

• 10–15+ years of Data Engineering experience.
• Active Databricks Certification required; Databricks Certified Data Engineer Professional preferred.
• Strong hands-on experience with Databricks, Apache Spark/PySpark, Delta Lake, Python, and SQL.
• Experience with Unity Catalog, Delta Live Tables (DLT), Databricks SQL, and Databricks Workflows.
• Strong knowledge of Medallion Architecture (Bronze/Silver/Gold) and data modeling.
• Experience with AWS, Azure, or GCP.
• Experience with Airflow or similar orchestration tools.
• Strong understanding of Git, CI/CD, and data pipeline development.
• Experience leading data engineering projects and mentoring teams.
• Healthcare industry experience is mandatory.