Quick Overview
Salary
$68 - $113/hr
Seniority
Mid Senior
Work mode
Remote
Location
United States
Posted
21 hours ago
GCPSQLETLFlinkMLOpsMachine LearningAgileAirflowApacheApache SparkBigQueryGitGoogle CloudHadoopHiveKafkaPython
Job Description
Title: Senior Data Engineer
Location: Remote
Job Type: Contract (6-12 Months)
Compensation: $67.66 - $112.78/hr
Industry: Retail
---
About the Role
We are hiring a Senior Data Engineer on behalf of our client, a large national retailer with a sophisticated technology organization supporting high-volume digital and enterprise operations.
This is a hands-on, execution-focused opportunity supporting a Data Services Engineering team within a fraud and abuse technology environment. The Senior Data Engineer will build, modernize, and operate large-scale data pipelines and platforms across Hadoop and Google Cloud Platform (GCP).
The ideal candidate is a strong individual contributor who can quickly become productive within an established architecture, independently own data engineering work from design through production support, and deliver reliable solutions for high-volume batch and streaming workloads.
Job Description
Qualifications
Required Qualifications:
Benefits
Dahl Consulting is proud to offer a comprehensive benefits package to eligible employees that will allow you to choose the best coverage to meet your family’s needs. For details, please review the DAHL Benefits Summary: https://www.dahlconsulting.com/benefits-w2fta/.
How to Apply
Take the first step on your new career path! To submit yourself for consideration for this role, simply click the apply button and complete our mobile-friendly online application. Once we’ve reviewed your application details, a recruiter will reach out to you with next steps!
Equal Opportunity Statement
As an equal opportunity employer, Dahl Consulting welcomes candidates of all backgrounds and experiences to apply. If this position sounds like the right opportunity for you, we encourage you to take the next step and connect with us. We look forward to meeting you!
#IT.Indeed
#LI-LM1
#LI-Remote
Location: Remote
Job Type: Contract (6-12 Months)
Compensation: $67.66 - $112.78/hr
Industry: Retail
---
About the Role
We are hiring a Senior Data Engineer on behalf of our client, a large national retailer with a sophisticated technology organization supporting high-volume digital and enterprise operations.
This is a hands-on, execution-focused opportunity supporting a Data Services Engineering team within a fraud and abuse technology environment. The Senior Data Engineer will build, modernize, and operate large-scale data pipelines and platforms across Hadoop and Google Cloud Platform (GCP).
The ideal candidate is a strong individual contributor who can quickly become productive within an established architecture, independently own data engineering work from design through production support, and deliver reliable solutions for high-volume batch and streaming workloads.
- Design, build, test, deploy, and support scalable batch and streaming data pipelines using Python, SQL, Apache Spark, Kafka, and related technologies.
- Support the modernization and migration of data pipelines and datasets from on-premises Hadoop environments to Google Cloud Platform (GCP), including BigQuery and other cloud-native services.
- Build and optimize ETL/ELT workflows for large-scale, high-volume datasets with an emphasis on performance, scalability, reliability, and cost efficiency.
- Develop trusted datasets supporting analytics, fraud investigation, reporting, and machine learning use cases.
- Implement appropriate data quality checks, testing, and validation processes.
- Troubleshoot production data issues, conduct root-cause analysis, and implement durable solutions to prevent recurring failures.
- Implement and maintain monitoring, alerting, automation, and CI/CD practices for production data pipelines.
- Work across both legacy Hadoop and modern GCP environments during ongoing platform modernization.
- Partner with engineers, analysts, data scientists, product teams, and other stakeholders to understand data requirements and deliver effective solutions.
- Identify technical risks, data quality concerns, performance issues, and opportunities to improve platform reliability.
- Contribute to technical design, code reviews, engineering standards, documentation, and knowledge transfer.
Required Qualifications:
- 5+ years of hands-on data engineering or related software engineering experience building large-scale data systems.
- Strong proficiency in Python and SQL.
- Hands-on experience with Apache Spark and distributed data processing.
- Experience with the Hadoop ecosystem, including HDFS and Hive.
- Hands-on experience with Kafka or another event-streaming technology.
- Experience building and supporting ETL/ELT and data integration pipelines.
- Experience with Google Cloud Platform data services, particularly BigQuery.
- Experience optimizing data pipelines for performance, scalability, reliability, and cost.
- Experience supporting production data systems, including monitoring, logging, incident troubleshooting, and operational support.
- Working knowledge of Git, CI/CD, automated testing, and Agile engineering practices.
- Ability to independently own data engineering work from design through production deployment and ongoing support.
- Strong communication and collaboration skills with the ability to work effectively across technical and business teams.
- Experience with additional GCP services such as Dataproc, Dataflow, Pub/Sub, or Cloud Storage.
- Experience migrating Hadoop workloads or enterprise data platforms to GCP or another public cloud environment.
- Experience with Spark Streaming, Flink, or similar stream-processing frameworks.
- Experience with data governance, lineage, security, privacy, and data quality frameworks.
- Experience with orchestration tools such as Airflow, Cloud Composer, Oozie, or similar technologies.
- Experience supporting machine learning data pipelines or GCP Vertex AI/MLOps workflows.
- Experience working with high-volume enterprise data in fraud, risk, security, retail, or e-commerce environments.
Dahl Consulting is proud to offer a comprehensive benefits package to eligible employees that will allow you to choose the best coverage to meet your family’s needs. For details, please review the DAHL Benefits Summary: https://www.dahlconsulting.com/benefits-w2fta/.
Take the first step on your new career path! To submit yourself for consideration for this role, simply click the apply button and complete our mobile-friendly online application. Once we’ve reviewed your application details, a recruiter will reach out to you with next steps!
As an equal opportunity employer, Dahl Consulting welcomes candidates of all backgrounds and experiences to apply. If this position sounds like the right opportunity for you, we encourage you to take the next step and connect with us. We look forward to meeting you!
#IT.Indeed
#LI-LM1
#LI-Remote
Similar jobs
- KA
Sr AWS Data Engineer with Strong Python/ PySpark with Snowflake Coretx ( Nearby GA , TX, FL , NJ)
NewK Anand Corporation
Dallas, TX🇺🇸Hybrid21 hours agoMicroservicesSQLAWS+3Technology - IU
Data Engineer
NewIBOTIX US Inc.
Richardson, TX🇺🇸On-site21 hours agoSQLScalaAWS+7Technology - VB
Data Engineer
NewVbeyond Corporation
Raleigh, NC🇺🇸Hybrid21 hours agoDockerAWSMachine Learning+5Technology - KG
Data Engineer
NewK&K Global Talent Solutions
Charlotte, NC🇺🇸On-site21 hours agoSQLAWSScrum+4Technology - RI
Oracle DBA
NewRIIM
Columbia, SC🇺🇸Hybrid21 hours agoOraclePL/SQLSQL+1Technology - QE
Data Engineer – Python, SQL, Spark, ETL | Dallas, TX (Onsite)
NewQentelli
Dallas, TX🇺🇸On-site21 hours agoSQLScalaETL+8Technology - SA
Data Configuration Manager
SAIC
El Segundo, CA🇺🇸$80.0k - $120k/yrRemote3 weeks agoConfluenceJiraTechnology - NI
Data Engineer (AI/ML Focus) - Google Cloud Platform
NewNityo Infotech Corporation
San Jose, CA🇺🇸Hybrid21 hours agoSQLScalaMLOps+8Technology - SI
Senior Data Engineer || Atlanta, Georgia- Must be Local
NewStellent IT LLC
Atlanta, GA🇺🇸Hybrid21 hours agoSAFeSQLAWS+13Technology - NI
Data engineer
NewNityo Infotech Corporation
San Antonio, TX🇺🇸Hybrid21 hours agoETLSnowflakePython+1Technology - LT
Senior Data Engineer (Local to IL)- W2
NewLorvenk Technologies LLC
Chicago, IL🇺🇸On-site21 hours agoOracleSQLSQL Server+1Technology - PS
Data Engineer Senior with Security Clearance
NewProcession Systems
Chantilly, VA🇺🇸Hybrid21 hours agoSQLETLTechnology