Quick overview
Job description
Job Title: Senior PySpark Developer
Location: Remote – US
Duration: 12 Months
Positions: 1
Experience: 10–12+ Years
Level: Senior / Lead Developer
Job Description:
Seeking a Senior PySpark Developer with strong hands-on experience in Cloudera CDP, Apache Iceberg, Airflow, and AWS to build and optimize large-scale data engineering solutions.
Mandatory Skills:
10+ years of overall IT experience with 6+ years in Data Engineering.
Strong hands-on experience with PySpark and Apache Spark.
Cloudera Data Platform (CDP).
Apache Iceberg and Lakehouse architecture.
Apache Airflow for workflow orchestration.
Strong SQL, ETL/ELT, and data modeling experience.
Large-scale data processing and pipeline development.
Data partitioning, performance tuning, and query optimization.
Git, CI/CD, and DevOps practices.
Good to Have:
AWS services: S3, Glue, Lambda, EMR, ECS/EKS, RDS, IAM, and CloudWatch.
Kafka and event-driven architecture.
Data quality, metadata, and data governance.
Healthcare, Medicaid, Claims Processing, or Insurance domain experience.
AWS or Cloudera certifications.
Key Responsibilities:
Design and develop scalable PySpark data pipelines.
Build and optimize ETL/ELT workflows using Cloudera CDP and Airflow.
Implement Apache Iceberg-based data lakehouse solutions.
Optimize distributed data processing and application performance.
Support cloud migration, modernization, and production deployments.
Collaborate with architects and engineering teams on enterprise data solutions.
Similar jobs
- TS

Full Stack Software Engineer with Security ClearanceRecently posted
The Swift Group · Herndon, VA · On-site · Posted 17 Nov 2026 🇺🇸
DockerNext.jsSQL+19Technology$5k/mo - ES
Embedded C++ DeveloperRecently posted
ENIN SYSTEMS INC · San Diego, CA · Hybrid · Posted 16 Nov 2026 🇺🇸
SVNGitEmbedded Systems+8TechnologySalary not listed - GL
Java Developer - Plano, TX - W2Recently posted
Geopaq Logic · Plano, TX · Hybrid · Posted 16 Nov 2026 🇺🇸
OracleSQLSpring+11TechnologySalary not listed - IT

Pega Robotics Developer / RPA DeveloperRecently posted
ITSYNTAX INC · United States · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLRoboticsScrum+7TechnologySalary not listed - AT
Senior Java Full Stack Engineer – Adobe AEM & Adobe Cloud ServicesRecently posted
Altitude Technology Solutions Inc · Columbus, OH · Hybrid · Posted 17 Nov 2026 🇺🇸
JavaRESTAgile+1TechnologySalary not listed - Y-

Senior Angular & NodeJS Developer - Onsite, Southlake, TX - W2 OnlyRecently posted
Yoh - A Day & Zimmerman Company · Dallas, TX · Hybrid · Posted 17 Nov 2026 🇺🇸
MicroservicesHTMLAWS+16Technology$44 - $63/hr - HE

Senior PL/I Developer–Banking & Card TokenizationRecently posted
Helishores Inc · United States · Remote · Posted 17 Nov 2026 🇺🇸
ShellGitJava+4TechnologySalary not listed - MW
Service Now DeveloperRecently posted
Mind Ware Inc · Minneapolis, MN · Hybrid · Posted 17 Nov 2026 🇺🇸
OAuthActive DirectoryCSS+5TechnologySalary not listed - AS
C/C++ DeveloperRecently posted
Apex Systems · Manassas, VA · On-site · Posted 15 Nov 2026 🇺🇸
MicroservicesGitScrum+12TechnologySalary not listed - JG

Sr AWS Java DeveloperRecently posted
Judge Group, Inc. · Plano, TX · On-site · Posted 17 Nov 2026 🇺🇸
MicroservicesOraclePL/SQL+9Technology$45 - $50/hr - GO

Appian DeveloperRecently posted
GovCIO · United States · Remote · Posted 17 Nov 2026 🇺🇸
RESTSOAPAgileTechnology$120k - $130k/yr - SO

UI UX DeveloperRecently posted
System One · Washington, DC · On-site · Posted 16 Nov 2026 🇺🇸
GitHTMLFigma+10TechnologySalary not listed