Haystack
← Back to Jobs
Other
CO

Azure Databricks Architect with Oil & Gas Exp

Compunnel Inc.Houston, TX🇺🇸United StatesPosted Sep 25, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Houston, TX, United States
Posted
4 days ago
SQLT-SQLETLMLOpsAirflowApacheAzureComplianceDatabricksPower BIPythonStakeholder ManagementUnity

Job Description

Key Responsibilities
Lead the development of scalable data pipelines and ETL/ELT frameworks using Azure Databricks and PySpark
Architect and optimize data ingestion, transformation, and consumption layers
Design data models, data dictionaries, and reusable data products
Implement data governance, quality, security, and compliance standards
Optimize Spark workloads, Databricks jobs, and overall platform performance
Collaborate with business users, data scientists, and cross-functional teams to translate business requirements into technical solutions
Mentor and guide data engineers and junior team members
Drive CI/CD automation and DevOps best practices for data platforms
Support Data Lakehouse architecture and enterprise analytics initiatives
Lead technical governance and support data platform delivery across enterprise-scale initiatives
Required Qualifications
10+ years of experience
Bachelors Degree
Skills
Azure Databricks
PySpark
Python
SQL and T-SQL
Azure Data Factory (ADF)
Azure Data Lake Storage (ADLS)
Azure Synapse Analytics
Delta Lake
Databricks Workflows
Azure DevOps
Data Warehousing
Unity Catalog
Apache Airflow
Power BI
Lakehouse Architecture
Data Governance
Data Modeling
Stakeholder Management
Mentoring and Coaching
Technical Governance
Performance Tuning and Optimization
Cloud Data Transformation Program Leadership
Oil & Gas Domain Experience
DataOps
MLOps
Schedule
Start date: 2026-10-06

Similar jobs