Haystack
← Back to Jobs
Technology
PA

Senior Data Engineer (Databricks)

PamTen IncNew York, NY🇺🇸United StatesPosted 3 Sept 2026

Why This Role Stands Out

This hybrid Senior Data Engineer role offers a fantastic opportunity to shape innovative data products and accelerate their path to production within a dynamic technology company. You'll thrive here if you're passionate about building robust data platforms and enjoy collaborating at the intersection of research and engineering, making a tangible impact on how data is accessed and utilized. Apply now to leverage your Databricks expertise in a role with significant professional growth potential.

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
New York, NY, United States
Posted
22 hours ago
SQLAirflowDatabricksPythonTerraformUnity

Job Description

Role: Senior Data Engineer (Databricks)
Location: NYC, NY & Seattle, WA (Hybrid)
 
Project description
We are seeking a seasoned professional whose role sits at the intersection of platform engineering, data engineering, and data product development. You will build reusable platform capabilities and data products that let quantitative researchers discover, access, and consume data across a complex, disparate landscape, and then accelerate the good prototypes to production.
This is a contractor position.
 
Responsibilities
  • Design, build, and enhance platform capabilities within Databricks and related technologies.
  • Build reusable data products and self-service capabilities.
  • Design and maintain data pipelines and integration frameworks.
  • Improve data quality, reliability, lineage, and monitoring.
  • Accelerate research-to-production delivery: prototype solutions alongside researchers; establish patterns that make productionization easier and faster; reduce friction between research and engineering workflows.
 
Skills
Must have
  • 10+ years of platform and data solutions experience
  • Hands-on Databricks experience (workspace, notebooks, jobs) and building platform capabilities
  • Python
  • SQL
  • Modern CI/CD, IaC (Terraform strongly preferred)
  • Data Governance and observability (Unity Catalog, lineage, monitoring)
  • Orchestration (Airflow)
  • AI fluency: use of AI agents (Claude Code preferred) as a primary tool to design, build, test, and support solutions
 
Nice to have
  • Financial domain experience, especially quant research
  • API development
  • PowerBI

Similar jobs