Haystack
← Back to Jobs
Engineering

Senior Databricks Engineer

Dia Software SolutionsAustin, TX🇺🇸United StatesPosted 27 Jul 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Hi,

Greetings from DIA SOFTWARE SOLUTIONS LLC!

We reaching out about an exciting Direct client opportunity with one of our clients. Please review the requirements and let me know if you are interested in this position?

Direct client Req:: Need Senior Databricks Engineer ,Hybrid, TX

PLEASE SEND THE RESUMES TO SKUMAR AT DIASOFTWARESOLUTIONS DOT COM !

Job Description:

  • Understands business objectives and problems, identifies alternative solutions, performs studies and cost/benefit analysis of alternatives. Analyzes user requirements, procedures, and problems to automate processing or to improve existing computer system: Confers with personnel of organizational units involved to analyze current operational procedures, identify problems, and learn specific input and output requirements, such as forms of data input, how data is to be; summarized, and formats for reports. Writes detailed description of user needs, program functions, and steps required to develop or modify computer program. Reviews computer system capabilities, specifications, and scheduling limitations to determine if requested program or program change is possible within existing system.
  • The Databricks Engineer should design, develop, and optimize scalable data solutions on Databricks, leveraging PySpark or Scala for large-scale data processing. Build and maintain ingestion pipelines, Declarative Pipelines (DLT), and Medallion Architecture (Bronze, Silver, Gold) to support enterprise analytics and reporting. Develop robust data models and implement data quality, validation, and governance frameworks. Create dynamic dashboards, Databricks Apps, and analytical solutions to deliver actionable business insights. Optimize workloads, monitoring, and operational processes to ensure scalability, security, and cost efficiency.

SKILLS MATRIX

Minimum Requirements: Candidates that do not meet or exceed the minimum stated requirements (skills/experience) will be displayed to customers but may not be chosen for this opportunity.

Actual
Years
Experience

Years
Experience
Needed

Required/
Preferred

Skills/Experience

8

Required

Experience in IT, supporting the design, development, deployment, or delivery of technology solutions.

8

Required

Experience with Databricks, including building and optimizing ETL/ELT data pipelines using Apache Spark.

8

Required

Experience in data warehousing and dimensional data modeling (star/snowflake schemas).

8

Required

Proficiency in SQL and Python (or Scala) for large-scale data processing.

8

Required

Experience designing and developing dashboards and applications natively within Databricks (e.g., Databricks SQL dashboards, Databricks Apps).

8

Required

Experience implementing data governance, data quality, and data security practices.

8

Required

Experience implementing Lakeflow Declarative Pipelines (formerly Delta Live Tables/DLT) for building and managing production data pipelines.

8

Required

Experience with Delta Lake, medallion architecture (bronze/silver/gold layers), data lakehouse design, and creating and scheduling offline jobs using Lakeflow Jobs (formerly Databricks Workflows) or similar orchestration tools (e.g., Airflow).

8

Required

Excellent communication skills, both verbal and written, including presenting insights to technical and business stakeholders.

1

Preferred

Experience working in public sector or state government environments.

1

Preferred

Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional).

1

Preferred

Experience with CI/CD practices for data pipelines (DevOps, Git-based workflows).

DIA SOFTWARE SOLUTIONS LLC.

SANGEETHA| DIA SOFTWARE SOLUTIONS LLC.

Direct: Eight Zero Four Three Six Five Six Six Five One

DIA SOFTWARE SOLUTIONS is an Affirmative Action/Equal Opportunity Employer that supports workplace diversity. All employment decisions are made without regard to race, color, religion, sex, national origin, age, disability, veteran status, marital or family status, sexual orientation, gender identity, or genetic information. All Dia soft staff must be able to demonstrate the legal right to work in the United States. DIA SOFTWARE SOLUTIONS is an E-Verify employer

Similar jobs