Quick overview
Job description
Responsibilities
• Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews
• Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources.
• Implement medallion/lakehouse architectures, dimensional models, and data transformation workflows to support analytics and reporting use cases
• Engineer solutions using technologies such as PySpark, Spark SQL, SQL, Python, Delta Lake, and orchestration tools within Azure and Databricks
• Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security
Minimum Requirements
• 6+ years of experience in data engineering, data platform development, or cloud data solutions
• 3+ years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies
• Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics, Power BI, Azure SQL, Azure Cosmos DB, and Azure Database for PostgreSQL
• Expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing, and Mosaic AI
• DevOps for data, GitHub, automated testing, and working with containers (AKS, Docker, registries, etc.)
• Excellent communication skills, ability to clearly explain concepts to teammates and customers, and quickly learn new concepts and technologies
Preferred Qualifications
• Experience building data agents, including NLQ, Databricks Genie, and Fabric Data Agents
• Experience with data management, including data governance, data security, master data management, and familiarity with different industry security requirements
• Broad experience with data/reporting tools, architectures, cloud vendors, and data/AI concepts other than Microsoft
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- ME

Customer Data Platform (CDP) ManagerRecently posted Auto Apply
Monster Energy · USA - Corona · Hybrid · Posted 18 Nov 2026 🇺🇸
SQLLookerCRM+5$116.3k/yr - CL

DEXPI Specialist (P&ID Data Exchange)Recently posted Auto Apply
Clera · United States · On-site · Posted 18 Nov 2026 🇺🇸
$90/hr - AF
Data Engineer - SeniorRecently posted Auto Apply
Accenture Federal Services · Chantilly · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLETLData AnalysisTechnology$106.3k - $221.1k/yr - KI

Senior Data EngineerRecently posted Auto Apply
Kin · Remote (United States) · Remote · Posted 17 Nov 2026 🇺🇸
SQLNumPySnowflake+5TechnologySalary not listed - FA

Systems Engineer (Data Flow/NiFi) Level 2Recently posted Auto Apply
Fantom Corporation · Fort Meade · On-site · Posted 17 Nov 2026 🇺🇸
ApacheComplianceComputer Vision+5TechnologySalary not listed - SI

Data Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerDynamoDB+23TechnologySalary not listed - SI

Data Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerDynamoDB+23TechnologySalary not listed - SI

Data Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerDynamoDB+23TechnologySalary not listed - BE

Senior Engineer, Data Auto Apply
Bellese · United States · Remote · Posted 22 Oct 2026 🇺🇸
Apache SparkAWSETL+7Engineering$128.7k - $153.4k/yr - PO
Data EngineerRecently posted Auto Apply
Pocket · San Francisco · On-site · Posted 17 Nov 2026 🇺🇸
SQLA/B TestingAirflow+7TechnologySalary not listed - SE

Principal Data Engineer Auto Apply
Serhant · Remote · Remote · Posted 4 Nov 2026 🇺🇸
SQLETLFlink+10Technology$180k/yr - SM

Senior DataOps EngineerRecently posted Auto Apply
Scout Motors · United States · Hybrid · Posted 16 Nov 2026 🇺🇸
DynamoDBMySQLSQL+12Technology$140k - $170k/yr
