Back to Jobs
Recently postedTechnology

Pyspark Developer

Ideate Technologies LLCIrving, TX🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationIrving, TX, United States
SQLApache SparkAWSETLData PipelineDatabricksGoogle CloudHadoopPythonAzureDelta Lake

Job description

Mandatory Skills & Requirements
PySpark
Python
Databricks
ETL
Hadoop
AWS
Strong experience in scalable data pipeline development and large-scale data processing
Data transformation and ETL workflow development
Experience with Databricks Lakehouse Platform
Key Responsibilities
Design, build, and optimize scalable data pipelines.
Process large datasets using PySpark.
Develop efficient data transformation and ETL workflows.
Implement data engineering solutions on the Databricks Lakehouse Platform.
Support reliable, scalable, and high-performance data processing requirements.
Preferred Skills
AWS, Azure, or Google Cloud Platform
SQL
Delta Lake
Data pipeline and PySpark performance tuning

Similar jobs