Azure Data engineers with Data bricks

Job Title:  Azure Data engineers with Data bricks

Location: Chino Hills, CA (In-Person Interview – Mandatory)

Duration: Longterm

Description:

Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF), Azure Databricks, and PySpark.

Develop and optimize ETL/ELT workflows to ingest, transform, and process structured and unstructured data.

Build data processing solutions using Apache Spark, PySpark, and Spark SQL.

Work with Azure Data Lake Storage Gen2 (ADLS) and Delta Lake for data storage, transformation, and management.

Implement Medallion Architecture (Bronze, Silver, and Gold layers) for data processing and analytics.

Develop and optimize SQL queries, data models, and data transformation logic.

Implement incremental data loads, change data capture (CDC), and data quality checks.

Optimize Spark jobs and Databricks workloads for performance, scalability, and cost efficiency.

Manage data orchestration, scheduling, monitoring, and error handling.

Implement data security, access controls, and governance using Azure and Databricks capabilities.

Collaborate with data architects, analysts, BI developers, and business stakeholders to deliver reliable data solutions.

Troubleshoot data pipeline failures and maintain data accuracy, consistency, and availability.

Use Git and CI/CD pipelines to manage code versioning, deployment, and release processes.