Start searching
Back to Jobs
Technology

Lead Data Engineer

Aroha TechnologiesBethlehem, PA🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeOn Site
LocationBethlehem, PA, United States
SQLShellApache SparkAWSETLData PipelineDatabricksData AnalysisLinuxDelta Lake

Job description

Lead Data Engineer Databricks

Position: Senior Data Engineer
Location: Bethlehem, New Jersey
Work Arrangement: Hybrid Minimum 2 Days On-site
Experience: 10+ Years in Data Engineering and ETL

Role Summary

We are seeking a strong Databricks-focused Data Engineer with expertise in ETL design, data pipeline development, and analytics, along with advanced SQL skills. Informatica experience is preferred to support legacy integration and migration initiatives.

Key Responsibilities

  • Design and develop scalable data pipelines using Databricks, PySpark, and Delta Lake.

  • Build and optimize ETL/ELT workflows in cloud data platforms.

  • Perform data analysis, transformation, and integration across systems.

  • Collaborate with business and architecture teams to translate requirements into technical solutions.

  • Lead ETL design, optimization, and migration initiatives from Informatica to Databricks.

  • Perform data quality checks, reconciliation, and performance tuning.

  • Support deployment, monitoring, and production support activities.

  • Handle production issues, incident resolution, and performance optimization.

Required Skills and Qualifications

  • 10+ years of experience in Data Engineering and ETL.

  • 8+ years of experience coordinating with onsite and offshore teams, business stakeholders, and delivery teams.

  • Strong expertise in Databricks, including:

    • PySpark

    • Databricks Notebooks

    • Delta Tables / Delta Lake

  • Advanced SQL skills, including querying, optimization, and analytics.

  • Strong understanding of ETL/ELT design and data warehousing concepts.

  • Experience in data modeling and data pipeline design.

Additional Requirements

  • Good exposure to cloud platforms, preferably AWS.

  • Experience with Unix Shell Scripting.

  • Experience working in a hybrid/onshore-offshore delivery model.

  • Informatica IDMC experience is preferred.

Primary Skills

  • Databricks

  • PySpark

  • Delta Lake

  • SQL

  • ETL/ELT Development

  • Data Engineering

  • Data Pipeline Design

Secondary Skills

  • Informatica IDMC

  • AWS

  • Unix Shell Scripting

  • Data Warehousing

  • Data Modeling

  • Data Quality and Reconciliation

  • Performance Tuning

  • Production Support

  • Onshore-Offshore Coordination

Similar jobs

Apply