Haystack
← Back to Jobs
Technology

Big Data Engineer

ExcelHire LLC - ATS TESTINGDallas, TX🇺🇸United StatesPosted 13 Aug 2026

Quick Overview

Salary
$65 - $75/hr
Work Type
Hybrid
Level
Mid Senior

Job Description

Big Data Engineer

Job Title: Big Data Engineer
Location: Dallas, TX, USA
Job Type: Contract
Work Mode: Hybrid
Start Date: 2026-09-01
End Date: 2027-08-31
Duration: 12 Months
Experience: 5–8 Years
Pay Rate: $65–$75/hour
Tax Terms: W-2 / C2C / 1099

Job Summary

We are seeking an experienced Big Data Engineer to design, develop, and maintain scalable data processing solutions and data pipelines. The ideal candidate will have strong experience with big data technologies, cloud platforms, distributed processing, ETL/ELT development, and data engineering practices.

Responsibilities

  • Design and develop scalable ETL/ELT data pipelines for large datasets.

  • Develop distributed data processing solutions using Apache Spark, Hadoop, and Hive.

  • Build data pipelines using Python, Scala, or Java.

  • Work with AWS, Azure, or Google Cloud Platform cloud platforms.

  • Develop and maintain data lake and data warehouse solutions.

  • Implement batch and real-time data processing pipelines.

  • Work with Kafka for real-time data ingestion and streaming.

  • Perform data cleansing, transformation, validation, and enrichment.

  • Optimize Spark jobs, SQL queries, and data pipelines for performance.

  • Work with relational and NoSQL databases.

  • Implement data quality, monitoring, logging, and error-handling processes.

  • Troubleshoot production data pipeline issues and perform root-cause analysis.

  • Collaborate with data scientists, analysts, developers, and business teams.

  • Implement data security, access control, and governance practices.

  • Maintain technical documentation and data pipeline procedures.

  • Participate in Agile/Scrum ceremonies and cross-functional team activities.

Required Skills

  • 5+ years of experience in Big Data Engineering or Data Engineering.

  • Strong hands-on experience with Apache Spark.

  • Experience with Hadoop, Hive, and HDFS.

  • Strong programming skills in Python, Scala, or Java.

  • Strong SQL skills.

  • Experience developing ETL/ELT pipelines.

  • Experience with AWS, Azure, or Google Cloud Platform.

  • Experience with Databricks or similar big data platforms.

  • Experience with Kafka and real-time data processing.

  • Knowledge of data lake and data warehouse architectures.

  • Strong understanding of data modeling.

  • Experience with Git and version control.

  • Strong troubleshooting and problem-solving skills.

Preferred Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

  • Experience with AWS Glue, EMR, S3, Redshift, Azure Data Factory, Synapse, ADLS, or Google BigQuery.

  • Experience with Apache Airflow or other workflow orchestration tools.

  • Experience with CI/CD and automated deployment.

  • Knowledge of data governance and security.

  • Experience working in enterprise-scale data environments.

  • AWS, Azure, or Google Cloud Platform certification is preferred.

  • Strong communication and collaboration skills.

Contract Details

Start Date: 2026-09-01
End Date: 2027-08-31
Duration: 12 Months
Extension: Possible based on project requirements and performance
Hours: Full-Time, approximately 40 hours/week
Work Mode: Hybrid
Location: Dallas, Texas, USA

Tax / Employment Terms

Available tax/employment terms are W-2, C2C, and 1099, subject to client requirements, candidate eligibility, and applicable U.S. laws.

Work Authorization

Candidates must have valid authorization to work in the United States. Specific work-authorization requirements may vary based on the client and tax/employment type.

Skills

SQL
Scala
AWS
ETL
Scrum
Agile
Airflow
Apache
Apache Spark
Azure
BigQuery
Data Pipeline
Databricks
Git
Google Cloud
Hadoop
Hive
Java
Kafka
Python
Redshift

Similar jobs