Quick Overview
Job Description
Key Responsibilities
Lead the development of scalable data pipelines and ETL/ELT frameworks using Azure Databricks and PySpark
Architect and optimize data ingestion, transformation, and consumption layers
Design data models, data dictionaries, and reusable data products
Implement data governance, quality, security, and compliance standards
Optimize Spark workloads, Databricks jobs, and overall platform performance
Collaborate with business users, data scientists, and cross-functional teams to translate business requirements into technical solutions
Mentor and guide data engineers and junior team members
Drive CI/CD automation and DevOps best practices for data platforms
Support Data Lakehouse architecture and enterprise analytics initiatives
Lead technical governance and support data platform delivery across enterprise-scale initiatives
Required Qualifications
10+ years of experience
Bachelors Degree
Skills
Azure Databricks
PySpark
Python
SQL and T-SQL
Azure Data Factory (ADF)
Azure Data Lake Storage (ADLS)
Azure Synapse Analytics
Delta Lake
Databricks Workflows
Azure DevOps
Data Warehousing
Unity Catalog
Apache Airflow
Power BI
Lakehouse Architecture
Data Governance
Data Modeling
Stakeholder Management
Mentoring and Coaching
Technical Governance
Performance Tuning and Optimization
Cloud Data Transformation Program Leadership
Oil & Gas Domain Experience
DataOps
MLOps
Schedule
Start date: 2026-10-06
Similar jobs
- RT
Streamer/Live Show Host
NewRefreshed Tech
Ashley, IN🇺🇸On-site21 hours agoFLSA - SO
Legislative Director
NewState of Washington
Olympia, WA🇺🇸$105k - $140k/yrRemote21 hours agoPerformance Management - GT
Senior Agile Program Integration Lead
NewGXM Technologies LLC
Colorado Springs, CO🇺🇸$150k - $210k/yrOn-site21 hours agoSAFeScrumAgile+7 - A&
General Maintenance
NewAtkins & Pearce Inc
Ft Mitchell, KY🇺🇸Hybrid21 hours agoREST - SK
Rental Coordinator
NewSkyworks LLC
Indianapolis, IN🇺🇸Hybrid21 hours agoInside SalesOutside Sales - GS
Membership Growth & Retention Specialist (NW 1)
NewGirl Scouts of Northern Illinois
Byron, IL🇺🇸$21/hrHybrid21 hours agoOnboardingRecruiting