Back to Jobs
Recently postedTechnology

PySpark Developer

Purple Drive Technologies LLCIrving, TX🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationIrving, TX, United States
SQLApache SparkAWSETLData PipelineDatabricksGoogle CloudHadoopPythonAzureDelta Lake

Job description

Job Description

PySpark Developer

Job Summary

We are seeking a PySpark Developer with strong experience in Python, ETL, and Databricks to design, build, and optimize scalable data pipelines. The role involves processing large datasets, developing data transformation workflows, and implementing data engineering solutions on the Databricks Lakehouse Platform.

Required Technical/Functional Skills

  • PySpark
  • Python
  • Databricks
  • ETL
  • Hadoop
  • AWS

Roles & Responsibilities

  • Design, build, and optimize scalable data pipelines.
  • Process large datasets using PySpark.
  • Develop efficient data transformation and ETL workflows.
  • Implement data engineering solutions on the Databricks Lakehouse Platform.
  • Support reliable and scalable data processing requirements.

Preferred Skills

Experience with the following is preferred:

  • AWS, Azure, or Google Cloud Platform
  • SQL
  • Delta Lake
  • Data pipeline and PySpark performance tuning

Similar jobs