Sr Data Engineer Lead/ Architect with Azure Databricks and Unity Catalog- Only W2 candidates will be considered. No C2C or third-party submissions.

Role Overview:
We are looking for an experienced Azure Databricks Engineer with strong hands-on expertise in cloud data engineering, ETL development, and distributed data processing. The ideal candidate should have strong experience with Azure Databricks, PySpark, Delta Lake, Azure Data Factory, and building scalable data pipelines on Azure.

Key Skills Required:

• Strong hands-on experience with Azure Databricks (Notebooks, Jobs, Workflows, Delta Lake)
• Expertise in PySpark, Spark SQL, DataFrames, optimization, and debugging
• Experience with Azure Data Factory (ADF) pipelines, triggers, and integration runtime
• Strong knowledge of ADLS Gen2, data partitioning, and security
• Experience with SQL and writing optimized queries
• Hands-on experience with Git, CI/CD, and Azure DevOps pipelines
• Knowledge of Lakehouse architecture, Azure Synapse, Kafka/Event Hub is a plus

The role involves designing and optimizing enterprise-scale data pipelines, working with architects and business teams, and contributing to data engineering solutions using modern Azure technologies.

Yashco Systems, Inc. is an Equal Opportunity Employer M/F/V/D.