Quick overview
Salary$69 - $107/hr
SeniorityMid Senior
Work modeHybrid
LocationBrooklyn Park, MN, United States
SQLGitApache SparkETLFlinkMLOpsAirflowApacheBigQueryGoogle CloudHadoopHiveKafkaPythonMachine LearningAgileCI/CD
Job description
We are looking for a Senior Data Engineer to help build, modernize, and support large-scale data pipelines across Hadoop and Google Cloud Platform. This hands-on contract role is a great fit for someone who enjoys solving complex data challenges, improving platform reliability, and delivering trusted datasets for analytics, fraud investigation, and machine learning use cases.
Responsibilities
Horizontal Talent is committed to diversity, equity, and inclusion, and we welcome candidates from all backgrounds and experiences. We believe inclusive teams create stronger solutions, and we are dedicated to fostering a respectful and supportive hiring experience for everyone.
By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.
Please apply through this online posting or by visiting our Job Board at Applications will be accepted for 4 weeks. For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. Check out all we have to offer and how you can become part of the Horizontal Talent Team. The pay range for this role is $69 - $107 per hour based on qualifications and experience.
Responsibilities
- Design, build, test, and maintain scalable batch and streaming data pipelines using Python, SQL, Spark, Kafka, and related tools.
- Support the migration and modernization of data workloads from on-premises Hadoop environments to Google Cloud Platform.
- Develop and optimize ETL/ELT workflows for large, high-volume datasets with attention to performance, reliability, and cost efficiency.
- Create and support trusted datasets that enable analytics, reporting, fraud analysis, and machine learning initiatives.
- Investigate production data issues, perform root-cause analysis, and implement durable fixes.
- Build monitoring, alerting, automation, and CI/CD practices that support stable production data systems.
- Collaborate with engineers, analysts, data scientists, and product partners to deliver timely data solutions.
- Contribute to code reviews, technical design discussions, documentation, and knowledge sharing.
- 5+ years of hands-on experience in data engineering or a related software engineering role building large-scale data systems.
- Strong proficiency in Python and SQL.
- Hands-on experience with Apache Spark and distributed data processing.
- Working knowledge of Hadoop technologies, including HDFS and Hive.
- Experience with Kafka or other event-streaming platforms.
- Experience building and supporting ETL/ELT and data integration pipelines.
- Experience with Google Cloud Platform data services, especially BigQuery.
- Experience supporting production data systems, including monitoring, logging, and incident troubleshooting.
- Familiarity with Git, CI/CD, automated testing, and Agile ways of working.
- Strong problem-solving skills and the ability to work independently within an established architecture.
- Experience migrating Hadoop workloads or enterprise data platforms to Google Cloud Platform or another public cloud.
- Experience with Dataproc, Dataflow, Pub/Sub, or Cloud Storage.
- Experience with Spark Streaming, Flink, or similar stream-processing frameworks.
- Exposure to data governance, lineage, privacy, security, and data quality frameworks.
- Experience with orchestration tools such as Airflow, Cloud Composer, or Oozie.
- Experience supporting ML data pipelines or Vertex AI / MLOps workflows.
- Background working with high-volume enterprise data in fraud, risk, security, retail, or e-commerce environments.
Horizontal Talent is committed to diversity, equity, and inclusion, and we welcome candidates from all backgrounds and experiences. We believe inclusive teams create stronger solutions, and we are dedicated to fostering a respectful and supportive hiring experience for everyone.
By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.
Please apply through this online posting or by visiting our Job Board at Applications will be accepted for 4 weeks. For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. Check out all we have to offer and how you can become part of the Horizontal Talent Team. The pay range for this role is $69 - $107 per hour based on qualifications and experience.
Similar jobs
- GS
Data Engineer Lead / Data Warehouse ArchitectRecently posted
Govan Systems inc · Lansing, MI · Hybrid · Posted 15 Nov 2026 🇺🇸
DockerSQLGit+18TechnologySalary not listed - CB

Data Engineer, Reporting & AnalyticsRecently posted
Cobalt Benefits Group LLC · Raleigh, North Carolina · Hybrid · Posted 9 Nov 2026 🇺🇸
SQLGitETL+13TechnologySalary not listed - SA
Data Operations EngineerRecently posted
SAIC · Honolulu, HI · Remote · Posted 15 Nov 2026 🇺🇸
Microsoft ExcelGitApache Spark+15Technology$80.0k - $120k/yr - ES
Lead Data Architect / Data EngineerRecently posted
Estaff LLC · Sacramento, CA · Hybrid · Posted 13 Nov 2026 🇺🇸
Stakeholder ManagementSQLApache Spark+8TechnologySalary not listed - AE

Sr. Data Engineer/Sr. Data ArchitectRecently posted
Aerospace Corporation · El Segundo, CA · On-site · Posted 13 Nov 2026 🇺🇸
DynamoDBMicroservicesMongoDB+10Technology$144.5k - $216.7k/yr - FO

Data Engineer LeadRecently posted
FedEx Office · Plano, TX · Hybrid · Posted 14 Nov 2026 🇺🇸
SQLScalaGit+12Technology$7.1k/mo - GU
Cleared Data Engineer with Security ClearanceRecently posted
Guidehouse · Arlington, VA · Hybrid · Posted 14 Nov 2026 🇺🇸
SQLApache SparkETL+2Technology$85k - $141k/yr - TM

Lead Data Engineer, Army NGC2Recently posted
The MITRE Corporation · Aberdeen, MD · On-site · Posted 13 Nov 2026 🇺🇸
DockerSQLGit+10Technology$155.2k - $194k/yr - PG

Data Engineer IIIRecently posted
PTR Global · Chicago, IL · Hybrid · Posted 14 Nov 2026 🇺🇸
OracleSQLMicrosoft Excel+16TechnologySalary not listed - LE

Data Engineer with Security ClearanceRecently posted
Leidos · Herndon, VA · Remote · Posted 14 Nov 2026 🇺🇸
SQLAWSETL+7Technology$87.1k - $157.4k/yr - RH

Data EngineerRecently posted
Robert Half · Bellevue, WA · Remote · Posted 14 Nov 2026 🇺🇸
SQLAWSETL+7Technology$45 - $55/hr - CO

Data EngineerRecently posted
Collabera LLC · New York, NY · Hybrid · Posted 14 Nov 2026 🇺🇸
SQLScalaApache Spark+14Technology$112k - $135k/yr