Haystack
← Back to Jobs
Technology

Databricks Data Engineer -14+ yrs Exp

ACS Consultancy Services, Inc.Austin, TX🇺🇸United StatesPosted 27 Jul 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Job Title: Databricks Data Engineer -14+ yrs Exp

Location: Austin, TX (Hybrid) -LOCAL ONLY candidates

We are currently seeking candidates who meet the following qualification

Key Responsibilities
  • Understand business objectives, challenges, and user requirements to recommend effective technology solutions.
  • Analyze existing operational procedures, identify system improvements, and evaluate alternative solutions through cost/benefit analysis.
  • Collaborate with business users and technical teams to gather input and output requirements, reporting needs, and data processing requirements.
  • Write detailed functional and technical specifications describing user needs, program functionality, and development requirements.
  • Evaluate system capabilities, specifications, and scheduling limitations to determine the feasibility of requested enhancements.
  • Design, develop, and optimize scalable data solutions using Databricks.
  • Develop large-scale ETL/ELT data pipelines using Apache Spark with Python or Scala.
  • Build and maintain Lakeflow Declarative Pipelines (formerly Delta Live Tables/DLT) for production-grade data processing.
  • Design and implement Delta Lake-based data lakehouse solutions using Medallion Architecture (Bronze, Silver, and Gold layers).
  • Create, schedule, and manage offline jobs using Lakeflow Jobs (formerly Databricks Workflows) or similar orchestration tools such as Airflow.
  • Develop robust dimensional data models, including star and snowflake schemas, to support enterprise reporting and analytics.
  • Implement data governance, data quality, validation, and security frameworks.
  • Design and develop Databricks SQL dashboards, Databricks Apps, and analytical solutions that deliver actionable business insights.
  • Optimize workloads, monitoring, operational processes, scalability, security, and cost efficiency across the data platform.
  • Communicate technical concepts, project updates, and analytical insights effectively to both technical and business stakeholders.
  • Support the design, development, deployment, and delivery of enterprise technology solutions.
  • Participate in DevOps and CI/CD processes for data pipeline deployment and lifecycle management.
Required Qualifications
  • Experience supporting the design, development, deployment, or delivery of technology solutions.
  • Hands-on experience with Databricks, including building and optimizing ETL/ELT data pipelines using Apache Spark.
  • Strong experience in data warehousing and dimensional data modeling, including star and snowflake schemas.
  • Proficiency in SQL and Python or Scala for large-scale data processing.
  • Experience designing and developing dashboards and applications natively within Databricks, including Databricks SQL Dashboards and Databricks Apps.
  • Experience implementing data governance, data quality, and data security best practices.
  • Experience implementing Lakeflow Declarative Pipelines (formerly Delta Live Tables/DLT) for production data pipelines.
  • Experience with Delta Lake, Medallion Architecture (Bronze, Silver, Gold), data lakehouse design, and creating and scheduling offline jobs using Lakeflow Jobs (formerly Databricks Workflows) or similar orchestration tools such as Airflow.
  • Excellent verbal and written communication skills with the ability to present technical information and business insights to diverse stakeholders.
Preferred Qualifications
  • Experience working in public sector or state government environments.
  • Databricks certification (such as Databricks Certified Data Engineer Associate or Professional).
  • Experience implementing CI/CD practices for data pipelines using DevOps and Git-based workflows.


    If you meet these qualifications, please submit your application via link provided in Linkedin
    Kindly do not call the general line to submit your application.

Skills

SQL
Scala
ETL
Snowflake
Airflow
Apache
Apache Spark
Data Pipeline
Databricks
Git
Python

Similar jobs

Browse related jobs

Apply now