Quick overview
Job description
Job Summary
We are seeking a highly skilled Data Engineer to design, develop, and optimize scalable data pipelines that process large volumes of data. The ideal candidate will have deep expertise in Python, PySpark, AWS Glue, and Amazon EMR, along with experience implementing data quality and lineage frameworks to ensure data integrity across enterprise data platforms.
Required Qualifications
- 5+ years of Data Engineering experience.
- Expert-level proficiency in Python and PySpark.
- Strong hands-on experience with AWS Glue and Amazon EMR.
- Experience building and supporting large-scale data pipelines (terabyte-scale preferred).
- Strong knowledge of Amazon S3 Data Lakes.
- Experience with Data Quality and Data Lineage implementations.
- Strong experience with PostgreSQL, MySQL, or AWS RDS.
- Excellent problem-solving and performance-tuning skills.
Preferred Qualifications
- Experience in the Financial Services industry.
- Hands-on experience with Kafka or AWS Kinesis for real-time data processing.
- Knowledge of CI/CD pipelines for data engineering workflows.
- Experience with Infrastructure as Code (IaC) tools such as Terraform or CloudFormation.
- Familiarity with Agile development methodologies.
Similar jobs
- KE
Data EngineerRecently posted Auto Apply
Keystone · Boston · Hybrid 🇺🇸
Applicant Tracking SystemsDockerGCP+17TechnologySalary not listed - VT

SME Software / Data Engineer with Security ClearanceRecently posted
VTG · Chantilly, VA · Hybrid 🇺🇸
MongoDBMySQLPL/SQL+14TechnologySalary not listed - ST

Senior Data/Visualization Engineer with Security ClearanceRecently posted
Sarela Technology Solutions · Fort Belvoir, VA · Hybrid 🇺🇸
Data AnalysisEngineering$123.5k - $132.5k/yr - IT
Data Engineer/DeveloperRecently posted Auto Apply
ITnova · Jersey City · Hybrid 🇺🇸
SQLData EntryData Pipeline+8TechnologySalary not listed - IB

Voice/Data EngineerRecently posted Auto Apply
Iron Bow Technologies · Washington · Hybrid 🇺🇸
ComplianceCost EstimationRisk Management+3TechnologySalary not listed - SA

Data Engineer - Mid Auto Apply
Spear Ai · Bolling · On-site 🇺🇸
TechnologySalary not listed - SA

Data Engineer - Senior Auto Apply
Spear Ai · Bolling · On-site 🇺🇸
TechnologySalary not listed - SA

Mission Data Engineer Auto Apply
Spear Ai · Washington · On-site 🇺🇸
SQLAWSAirflow+2TechnologySalary not listed - BA

Data Engineer with Security ClearanceRecently posted
Booz Allen Hamilton · Virginia Beach, VA · On-site 🇺🇸
SQLScalaAWS+15Technology$77.5k - $176k/yr - ZP

Entry to Sr. Data Engineer (TS/SCI) with Security ClearanceRecently posted
Zachary Piper Solutions, LLC · Honolulu, HI · On-site 🇺🇸
SQLMicrosoft ExcelAWS+8Technology$130k - $220k/yr - SE
Data Engineer (in person) Auto Apply
Sep · Westfield · On-site 🇺🇸
TechnologySalary not listed - SE
Senior Data Engineer (in person) Auto Apply
Sep · Westfield · On-site 🇺🇸
TechnologySalary not listed
