Haystack
← Back to Jobs
Technology

Python / PySpark Data Engineer

Hadiamondstar Software Solutions LLCReston, VA🇺🇸United StatesPosted 14 Jul 2026

Why This Role Stands Out

Leverage your extensive Python and PySpark expertise to build innovative big data solutions within a dynamic hybrid work environment. You'll thrive here if you possess strong AWS and data pipeline development skills, driving impactful projects and continuous learning at Hadiamondstar Software Solutions LLC.

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Qualifications
10+ years hands-on Python development experience for big data application.
Extensive working experience in implementing scalable and efficient data processing pipelines using big data technologies, such as Hadoop/EMR, Spark, Hive.
Strong development experience in AWS platforms/services such as Lambda, Eventbridge, Step Functions, Redshift, S3, Glue.
Extensive hands-on development experience in making API calls, SQL queries, data manipulation/transformation, analysis and visualization.
Strong experience in data analysis/mining, hands-on experience on analyzing large datasets and extracting meaningful insights.
Solid understanding and hand-on implementation experience in CI/CD pipeline. Familiar with tools such as Gitlab/Terraform.
Critical thinking and strong analytical skills to drive solutions, alternative plans, and conclusions
Collaborates effectively and forms positive partnerships with team members in groups and levels across a matrixed organization
Possess strong analytical and problem-solving skills
Skills
Required 10+ years of Python development experience for big data application
Required 5+ years of development experience in AWS platforms/services such as EMR, Lambda, Eventbridge, Step Functions, Redshift, S3, Glue
Required 5+ years of development experience in making API calls, SQL queries, Spark, data manipulation/transformation, analysis and visualization
Hands on experience with CI/CD pipeline tools such as Gitlab/Terraform

Skills

SQL
AWS
Hadoop
Hive
Python
Redshift
Terraform

Similar jobs

Apply now