Senior Data Engineer with Azure & Databricks

Job Role: Senior Data Engineer with Azure & Databricks  

Location: Plano, TX or Conshohocken, PA Hybrid 2-3 days

Year of Experience: 12+ Years 

Type: Fulltime only

Job Summary

We are looking for an experienced Senior Data Engineer with strong expertise in Azure Data Engineering and hands-on experience building scalable data pipelines and data processing solutions.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and data engineering solutions.
• Develop ETL/ELT workflows using Azure Data Factory (ADF).
• Build and optimize data solutions using Azure Synapse Analytics and Databricks.
• Perform data ingestion, transformation, integration, and processing across multiple data sources.
• Develop efficient and scalable data models and workflows.
• Monitor, troubleshoot, and optimize data pipelines and data processing jobs.
• Collaborate with data architects, analysts, developers, and business stakeholders.

Required Skills

• Strong hands-on experience in Data Engineering.
• Strong expertise in Microsoft Azure data services.
• Experience with Azure Data Factory (ADF).
• Experience with Azure Synapse Analytics.
• Strong experience with Databricks.
• Strong SQL and data transformation skills.
• Experience developing and optimizing ETL/ELT pipelines.
• Good understanding of data warehousing and cloud data architecture.

Preferred Skills

• Experience with PySpark / Spark and Python.
• Experience with Azure Data Lake Storage (ADLS).
• Knowledge of Delta Lake and Lakehouse architecture.
• Experience with CI/CD and Azure DevOps.
• Experience with data modelling and performance optimization.
• Exposure to Power BI and analytics platforms.
• Microsoft Azure Data Engineer certification is a plus.