Quick overview
Job description
Hello,
I am Mohammed Dastagir with Saxon Global Inc wanted to let you know about the job opportunity for Lead Azure Databricks Engineer position if interested please share your updated resume along with expecting rate.
Job Title: Lead Azure Databricks Engineer
Location: Dallas, TX--Onsite
duration: 12 + months contract
Only on W2
Job Summary
We are looking for an experienced Azure Databricks Data Engineer with strong expertise in designing, developing, and implementing scalable data engineering solutions using Microsoft Azure and Databricks. The ideal candidate should have hands-on experience in building ETL/ELT pipelines, processing large datasets, implementing data lakehouse architectures, and optimizing data workflows.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Databricks.
- Develop data transformation workflows using PySpark, Spark SQL, and Python.
- Build and manage ETL/ELT pipelines to process structured and unstructured data.
- Work with Azure Data Factory (ADF) for data orchestration and pipeline scheduling.
- Implement data lake and lakehouse solutions using Azure Data Lake Storage Gen2.
- Work with Delta Lake, Delta Tables, and Medallion Architecture (Bronze, Silver, Gold).
- Perform data cleansing, transformation, aggregation, and validation.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Implement data security, governance, and access controls using Unity Catalog.
- Integrate data from multiple sources, including SQL databases, APIs, files, and cloud storage.
- Monitor, troubleshoot, and resolve data pipeline failures.
- Collaborate with data architects, analysts, and business stakeholders.
- Implement CI/CD processes using Azure DevOps and Git.
Required Technical Skills
- Strong experience with Azure Databricks.
- Hands-on experience with PySpark and Apache Spark.
- Strong programming skills in Python and SQL.
- Experience with Azure Data Factory (ADF).
- Good knowledge of Azure Data Lake Storage Gen2 (ADLS).
- Experience with Delta Lake and Delta Live Tables / Lakeflow Declarative Pipelines.
- Understanding of data warehousing and data lakehouse concepts.
- Experience in building batch and incremental data processing pipelines.
- Knowledge of Spark optimization techniques, partitioning, and caching.
- Experience with Azure DevOps, Git, and CI/CD pipelines.
Preferred Skills
- Experience with Databricks Unity Catalog and data governance.
- Knowledge of Databricks Workflows and job scheduling.
- Experience with Azure Synapse Analytics.
- Knowledge of dimensional modeling and data warehousing.
- Experience with streaming technologies such as Structured Streaming and Event Hubs.
- Familiarity with Terraform and Infrastructure as Code.
- Understanding of cloud security, RBAC, and managed identities.
- Experience with Power BI and downstream data consumption.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 10 years of experience in Data Engineering.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration skills.
Key Competencies
- Azure Cloud Data Engineering
- Azure Databricks Development
- PySpark and Spark SQL
- ETL/ELT Development
- Delta Lake and Lakehouse Architecture
- Data Pipeline Optimization
- Data Integration and Transformation
- Data Governance and Security
- CI/CD and DevOps
Mohammed Dastagir
Sr Resource Manager
Saxon Global Inc.
a:
Linked in:
w: e: dastagir.m
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- DL
Swine HerdsmanRecently posted
Danner Livestock · Chalmers, IN · Hybrid · Posted 19 Nov 2026 🇺🇸
PigSalary not listed - EX
IT Inventory AssociateRecently posted
Excelraise LLC · Kennesaw, GA · On-site · Posted 20 Nov 2026 🇺🇸
Microsoft ExcelMicrosoft OfficeInventory ControlSalary not listed - BT
Product AnalystRecently posted
Boston Technology Corporation · Columbus, OH · Hybrid · Posted 20 Nov 2026 🇺🇸
Business AnalysisSalary not listed - SS
Websphere Integration Tech-Remote(USA)-W2 Role -Exp 12+yrsRecently posted
SSTech LLC · United States · Remote · Posted 20 Nov 2026 🇺🇸
MicroservicesGitAWS+16Salary not listed - SO

Performance ConsultantRecently posted
System One · Fort Meade, MD · On-site · Posted 20 Nov 2026 🇺🇸
Stakeholder ManagementPortfolio ManagementRisk Management+2Salary not listed - SH

Set Your Own Schedule - Shop and Deliver GroceriesRecently posted
Shipt · Champaign, IL · Hybrid · Posted 20 Nov 2026 🇺🇸
AndroidSalary not listed - TD

.NET ARCHITECTRecently posted
The Dignify Solutions, LLC · United States · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerMicroservicesSQL+7Salary not listed - AC

ADS & ADAS TechnicianRecently posted
AVA Consulting · Ann Arbor, MI · Hybrid · Posted 20 Nov 2026 🇺🇸
ADASASE CertificationVehicle DynamicsSalary not listed - TE
Administrative Athletic ManagerRecently posted
TECKNOMIC LLC · Washington, DC · On-site · Posted 20 Nov 2026 🇺🇸
CanvaSchedulingInstagramSalary not listed - MU

AI-Enabled Remediation Engineer(Linux)Recently posted
MphasiS Corporation USA · Alpharetta, GA · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerGitAWS+16Salary not listed - PN

Principal AI Researcher (Prisma AIRS)Recently posted
PaloAlto Networks · CA · On-site · Posted 20 Nov 2026 🇺🇸
PythonMachine LearningData Analysis$172.1k - $278.3k/yr - GR
End User Computing (EUC) Support Analyst in Albany, NYRecently posted
GD Resources LLC · Albany, NY · Hybrid · Posted 20 Nov 2026 🇺🇸
Microsoft OfficeActive DirectoryHelp Desk+4Salary not listed
