Quick overview
Job description
W2 position ,No C2C
Any Visa is okay except H1b
Location: Malvern, PA - onsite 3 days per week
Experience: 7+ years in enterprise Data Engineering
Interview: First-round interview must be in person in Malvern, PA
Assessment: Ropes test required
Must-Have: Candidates must have strong, hands-on experience building ETL pipelines using Databricks.
Role OverviewSeeking an experienced Data Engineer to build and optimize scalable data pipelines, migrate jobs from Amazon EMR to Databricks, and support data analysis initiatives. This role partners with business analysts to ensure data availability and integrity for financial applications and reporting platforms. Responsibilities also include creating job aids and training analysts.
Key Responsibilities-
Build, implement, and optimize enterprise ETL/ELT pipelines using Databricks, Python, PySpark, and AWS Glue.
-
Migrate existing jobs from Amazon EMR to Databricks.
-
Extract and integrate data from legacy and modern sources.
-
Support large-scale, distributed data processing and cloud data platforms.
-
Ensure data quality, availability, and reliability across financial and reporting systems.
-
Provide production support and troubleshoot pipeline issues.
-
Implement CI/CD pipelines using Git and GitHub Actions.
-
Create technical documentation and job aids, and train analysts.
-
Collaborate with business analysts and stakeholders in an Agile/Scrum environment.
-
Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
-
7+ years of enterprise Data Engineering experience.
-
Strong Python development and advanced SQL programming skills.
-
Extensive hands-on experience with Apache Spark, PySpark, Databricks, and AWS Glue.
-
Experience with AWS S3, Athena, Lambda, Step Functions, and EventBridge.
-
Proven experience building enterprise ETL/ELT pipelines.
-
Strong understanding of distributed data processing, data lakes, and Medallion Architecture.
-
Strong knowledge of dimensional data modeling.
-
Experience with Git, GitHub Actions, and CI/CD implementation.
-
Familiarity with Agile/Scrum methodologies.
-
Excellent communication and stakeholder management skills.
-
Infrastructure as Code: CloudFormation / Terraform
-
AI/ML Platform: Amazon SageMaker
-
Financial Services or Asset Management experience.
-
Knowledge of Apache Iceberg, Delta Lake, or Hudi.
-
Experience with Apache Airflow.
-
Knowledge of Kafka or Amazon Kinesis streaming.
-
Experience supporting AI/ML and advanced analytics platforms.
-
AWS Professional or Specialty certifications.
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- GR

Forward Deployed EngineerRecently posted Auto Apply
Graymatter Robotics · United States · Remote · Posted 22 Nov 2026 🇺🇸
MATLABRoboticsROS+1Engineering$90k - $300k/yr - CL

Founding Engineering LeadRecently posted Auto Apply
Clera · New York · Remote · Posted 22 Nov 2026 🇺🇸
LLMMachine LearningEngineering$200k - $400k/yr - CL

Founding Harness EngineerRecently posted Auto Apply
Clera · San Francisco · On-site · Posted 22 Nov 2026 🇺🇸
LLMEngineering$200k/yr - RE

Solutions Engineering ManagerRecently posted Auto Apply
Resolveai · San Francisco · Hybrid · Posted 22 Nov 2026 🇺🇸
GitAWSLinear+6EngineeringSalary not listed - PE

Supplier Quality Engineer IRecently posted Auto Apply
Penumbrainc · Alameda · On-site · Posted 22 Nov 2026 🇺🇸
Microsoft ExcelMicrosoft PowerPointCompliance+2Engineering$76k - $100k/yr - OP

Mechanical Engineer - Applications EngineeringRecently posted Auto Apply
OPEX · Moorestown · Hybrid · Posted 22 Nov 2026 🇺🇸
OracleMicrosoft ExcelMicrosoft Office+6Engineering$100k - $130k/yr - CA

Data Migration EngineerRecently posted
Capgemini America, Inc. · United States · Hybrid · Posted 19 Nov 2026 🇺🇸
Generative AIEngineering$80.4k - $106.0k/yr - TT
Founding Reinforcement Learning EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 22 Nov 2026 🇺🇸
SwiftAWSReact Native+4Engineering$125k - $200k/yr - TT
Electrical & Computer EngineerRecently posted Auto Apply
True Talent Solutions Partners · Los Angeles · On-site · Posted 22 Nov 2026 🇺🇸
C++PythonLinuxEngineering$120k - $220k/yr - TT
Senior Power Electronics EngineerRecently posted Auto Apply
True Talent Solutions Partners · Rio Rancho · On-site · Posted 22 Nov 2026 🇺🇸
MATLABRoboticsAltium+2Engineering$150k - $200k/yr - TT
Engineering LeadRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 22 Nov 2026 🇺🇸
PythonReactPostgreSQL+1Engineering$221k - $295k/yr - TT
Director of Engineering (Product)Recently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 22 Nov 2026 🇺🇸
MongoDBAWSPython+2Engineering$210k - $240k/yr
