Quick overview
SeniorityMid Senior
Work modeHybrid
LocationGlen Allen, VA, United States
ScalaApache SparkAWSETLApacheData PipelinePython
Job description
Title: Ab Initio ETL Data Engineer
Location: Richmond, VA (3 Days Hybrid)
Duration: 7 Months with possible extension
Tech Skills:
Data movement and transformation
- Scrubbing and moving production data into QA environments
-
ETL pipeline development
-
Ab Initio - Must Have
Preferred Skills
- Spark
- Scala
- Python
- AWS
- Data processing frameworks
Job Summary
We are seeking an experienced ETL / Data Engineering Developer to design, develop, and maintain data pipelines and ETL processes. The ideal candidate will have hands-on experience with data movement, transformation, data cleansing, and Ab Initio. The role involves preparing production data for QA environments and ensuring data quality, accuracy, and reliability.
Key Responsibilities
-
Develop, maintain, and optimize ETL pipelines for data extraction, transformation, and loading.
-
Manage data movement and transformation across multiple systems and environments.
-
Scrub, cleanse, and prepare production data for use in QA and testing environments.
-
Develop and support data processing workflows using Ab Initio.
-
Ensure data quality, integrity, consistency, and reliability throughout ETL processes.
-
Troubleshoot data pipeline issues and optimize performance.
-
Collaborate with development, QA, and data teams to support data integration and testing requirements.
-
Follow data security, governance, and best practices when handling production data.
Required Skills
-
Hands-on experience in ETL development and data engineering.
-
Strong understanding of data movement, transformation, and data cleansing processes.
-
Experience with Ab Initio and ETL pipeline development.
-
Understanding of data integration, data quality, and processing workflows.
Preferred Skills
-
Experience with Apache Spark and Scala.
-
Programming experience in Python.
-
Familiarity with AWS data services and cloud-based data processing.
-
Knowledge of distributed computing and data processing frameworks.
-
Experience troubleshooting and optimizing large-scale data pipelines.
Similar jobs
- AD

Database Administrator - AssociateRecently posted Auto Apply
Agile Defense · Fort Huachuca · On-site 🇺🇸
AzureAgileTechnologySalary not listed - MT

Data Warehouse SpecialistRecently posted Auto Apply
MKS2 Technologies · Arlington · Hybrid 🇺🇸
SQLMicrosoft ExcelMicrosoft Office+7TechnologySalary not listed - PR

Sr Data Engineer Auto Apply
Protective · Birmingham · Remote 🇺🇸
SQLDatabricksPython+1Technology$84k - $128.7k/yr - MO

Senior Data Engineer Auto Apply
Momsmeals · Ankeny · Remote 🇺🇸
OnboardingComplianceContinuous Improvement+6TechnologySalary not listed - EG

Senior Data Engineer Agentic AI & DatabricksRecently posted
Enexus Global · Mountain View, CA · Hybrid 🇺🇸
Neo4jSQLApache Spark+10TechnologySalary not listed - LO

Data Engineer or Data ArchitectRecently posted
LOGICEXCELL LLC · Boston, MA · Hybrid 🇺🇸
DockerMicroservicesSQL+18TechnologySalary not listed - NY

Sr. Data EngineerRecently posted
New York Technology Partners · Parsippany-Troy Hills, NJ · Hybrid 🇺🇸
SQLScalaGit+5TechnologySalary not listed - IS

Azure Data Engineer with MS Fabric and Power BIRecently posted
IRIS Software, Inc. · United States · Hybrid 🇺🇸
SQLT-SQLApache Spark+10TechnologySalary not listed - TT

Senior Data Manager with Security ClearanceRecently posted
Torch Technologies Inc. · Hanscom AFB, MA · Remote 🇺🇸
Microsoft OfficeMicrosoft TeamsSharePointTechnology$110k - $125k/yr - KT

Senior Data EngineerRecently posted
Kforce Technology Staffing · Sandy Springs, GA · Hybrid 🇺🇸
OracleSQLHTML+5TechnologySalary not listed - TC
Sr. Data Engineer on application developmentRecently posted
Techwave Consulting Inc · East Hartford, CT · Hybrid 🇺🇸
Stakeholder ManagementSQLGit+8TechnologySalary not listed - SP

Data Engineer (FAANG EXP)Recently posted
Spiceorb · Frisco, TX · Hybrid 🇺🇸
SQLApache SparkSnowflake+13TechnologySalary not listed