Haystack
← Back to Jobs
Engineering

Databricks Engineer

ArnAmy, Inc.Austin, TX🇺🇸United StatesPosted 29 Jul 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Databricks Engineer

Introduction:

The Databricks Engineer will be responsible for designing, developing, and optimizing scalable data solutions on Databricks, utilizing PySpark or Scala for large-scale data processing. They will play a key role in building and maintaining ingestion pipelines, Declarative Pipelines (DLT), and Medallion Architecture to support enterprise analytics and reporting. This role requires expertise in data modeling, data quality, governance, and the ability to create dynamic dashboards and analytical solutions to drive actionable business insights.

Responsibilities:

  • Design, develop, and optimize scalable data solutions on Databricks using PySpark or Scala.
  • Build and maintain ingestion pipelines, Declarative Pipelines, and Medallion Architecture (Bronze, Silver, Gold) for enterprise analytics.
  • Develop robust data models and implement data quality, validation, and governance frameworks.
  • Create dynamic dashboards, Databricks Apps, and analytical solutions to deliver actionable business insights.
  • Optimize workloads, monitoring, and operational processes to ensure scalability, security, and cost efficiency.

Requirements:

Minimum Requirements:
YearsRequired/PreferredExperience
8RequiredExperience in IT, supporting the design, development, deployment, or delivery of technology solutions.
8RequiredExperience with Databricks, including building and optimizing ETL/ELT data pipelines using Apache Spark.
8RequiredExperience in data warehousing and dimensional data modeling (star/snowflake schemas).
8RequiredProficiency in SQL and Python (or Scala) for large-scale data processing.
8RequiredExperience designing and developing dashboards and applications natively within Databricks.
8RequiredExperience implementing data governance, data quality, and data security practices.
8RequiredExperience with Delta Lake, medallion architecture, data lakehouse design, and creating and scheduling offline jobs using orchestration tools.
8RequiredExcellent communication skills, both verbal and written, including presenting insights to technical and business stakeholders.
1PreferredExperience working in public sector or state government environments.
1PreferredDatabricks certification (e.g., Databricks Certified Data Engineer Associate/Professional).
1PreferredExperience with CI/CD practices for data pipelines (DevOps, Git-based workflows).

Similar jobs

Apply now