Haystack
← Back to Jobs
Technology
SF

Databricks Senior Data Engineer -Pyspark

SmartIT FrameNew York, NY🇺🇸United StatesPosted Oct 5, 2026

Quick Overview

Seniority
Mid Senior
Work mode
On Site
Location
New York, NY, United States
Posted
20 hours ago
DockerSQLAWSETLBigQueryData PipelineDatabricksGitGoogle CloudKafkaKubernetesPythonUnitypytest

Job Description

Hiring: Senior Data Engineer – Databricks/PySpark

Location: New York, NY – Onsite

Requirements:

  • 7+ years of Data Engineering experience

  • 4+ years hands-on with Databricks & Spark/PySpark

  • Strong Python, SQL, Delta Lake

  • Experience with AWS (S3, Glue) and Google Cloud Platform (BigQuery, GCS)

  • Strong ETL/ELT, Spark optimization & data pipeline development

  • Experience with CI/CD, Git, pytest

  • Excellent communication and technical documentation skills

  • Consulting/project delivery experience

Nice to Have: Kafka, Spark Streaming, DLT, Unity Catalog, Docker/Kubernetes.

Similar jobs