Haystack
← Back to Jobs
Technology
ST

Databricks Developer

Shiro TechnologiesUnited States🇺🇸United StatesPosted Oct 16, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
United States
Posted
3 days ago
SQLETLAgileAzureDatabricksGitHub ActionsPython

Job Description

Position Overview:
We are seeking an experienced Mid - Senior Databricks Developer with 8–10+ years of industry experience to design, develop, and optimize large‑scale data solutions. The ideal candidate will have strong expertise in Databricks, Python, SQL, and Microsoft Azure cloud services. A minimum of a Bachelor’s degree is required.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines and ETL workflows using Databricks.
  • Build and optimize Delta Lake architectures and data models.
  • Develop high‑quality, reusable code in Python for data processing and automation.
  • Write and optimize complex SQL queries for large datasets.
  • Implement and manage solutions on Microsoft Azure, including Azure Data Lake, Azure Data Factory, and related services.
  • Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver high‑quality solutions.
  • Ensure data quality, reliability, and performance across all pipelines.
  • Troubleshoot production issues and perform root‑cause analysis.
  • Follow best practices for version control, CI/CD, and cloud security.

Required Qualifications:

  • Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field (minimum requirement).
  • 8–10+ years of experience in data engineering or software development.
  • Strong hands‑on experience with Databricks (including notebooks, jobs, clusters, Delta Lake).
  • Advanced proficiency in Python for data engineering.
  • Strong expertise in SQL, including performance tuning.
  • Solid experience with Microsoft Azure cloud services.
  • Experience working with large‑scale distributed data systems.
  • Strong problem‑solving skills and ability to work independently.

Preferred Skills (Nice to Have)

  • Experience with CI/CD tools (Azure DevOps, GitHub Actions).
  • Knowledge of Spark performance optimization.
  • Experience with data governance and security frameworks.
  • Familiarity with Agile methodologies.

Please share the candidate rating in the format provided below along with all required information.

Skill

Rate (0/10)

Databrick experience

Python

SQL

Microsoft Assure Cloud

Experience with CI/CD

Similar jobs