Start searching
Back to Jobs
Technology

Databricks Senior Data Engineer -Pyspark

SmartIT FrameNew York, NY🇺🇸United States

Why this role stands out

Elevate your engineering career at SmartIT Frame by architecting high-impact data solutions using cutting-edge Databricks and PySpark technologies in the heart of New York City. This role is perfect for a collaborative expert who thrives on building scalable pipelines and wants to sharpen their skills alongside a high-performing team of technical innovators. Apply today to take this exciting next step in your professional journey and drive meaningful impact through advanced data engineering.

Quick overview

SeniorityMid Senior
Work modeOn Site
LocationNew York, NY, United States
DockerSQLAWSETLBigQueryData PipelineDatabricksGitGoogle CloudKafkaKubernetesPythonUnitypytest

Job description

Hiring: Senior Data Engineer – Databricks/PySpark

Location: New York, NY – Onsite

Requirements:

  • 7+ years of Data Engineering experience

  • 4+ years hands-on with Databricks & Spark/PySpark

  • Strong Python, SQL, Delta Lake

  • Experience with AWS (S3, Glue) and Google Cloud Platform (BigQuery, GCS)

  • Strong ETL/ELT, Spark optimization & data pipeline development

  • Experience with CI/CD, Git, pytest

  • Excellent communication and technical documentation skills

  • Consulting/project delivery experience

Nice to Have: Kafka, Spark Streaming, DLT, Unity Catalog, Docker/Kubernetes.

Similar jobs

Apply