Data Engineer

Data Engineer (PySpark) – Short Job Description

Role: Data Engineer – PySpark

Key Responsibilities:

• Develop and maintain ETL/data pipelines using PySpark.
• Process and transform large datasets efficiently.
• Write optimized SQL queries for data extraction and analysis.
• Build and maintain data lakes/data warehouses.
• Optimize Spark jobs for performance and scalability.
• Work with cloud platforms (AWS/Azure/Google Cloud Platform) and workflow tools like Airflow.
• Collaborate with data analysts, data scientists, and software teams to deliver reliable data solutions.

Required Skills:

• Python, PySpark, SQL
• Apache Spark
• ETL/ELT development
• Data Warehousing concepts
• Git
• Airflow (preferred)
• Experience with AWS, Azure, or Google Cloud Platform (preferred)