Quick overview
Job description
Location: Dallas, TX (Hybrid)
- Design, build, and maintain scalable data ingestion and processing pipelines using SQL , Spark, Hadoop, Airflow, SnapLogic, or similar tools
- Optimize existing ETL/ELT workflows and resolve bottlenecks in production jobs
- Integrate multiple structured and unstructured data sources from internal and external systems
- Design and implement event-driven data pipelines using event bus architectures (Kafka, AWS EventBridge, SNS/SQS, or similar)
- Build and maintain event producers, consumers, and stream processors for real-time and near-real-time data flows
- Manage event schema design, schema registry, and versioning to ensure backward compatibility across consumers
- Monitor event bus health, lag, throughput, and reliability; respond to failures before SLA breach
- Implement and manage CI/CD pipelines for data workflows using Git, Jenkins, or GitHub Actions
- Ensure robust job scheduling, monitoring, logging, and end-to-end testing of data pipelines
- Debug and resolve production issues before SLA breach; participate in on-call rotation
- Collaborate with backend and BI teams for API and data integration
- Design and develop schema definitions; support data warehouse/mart to integrate disparate data sources and make them available for analysis
- Support large data volumes and flexible provisioning of new data sources
- Contribute to data architecture design across the data landscape
- Write clean, reusable, well-tested Python and Shell code across the full software development lifecycle
- Gather functional requirements, develop technical specifications, and own project and test planning
- Work in Agile/Scrum environments; help align team priorities across the organization
- Leverage AI-assisted dev tools (Claude, Cursor .. etc) to accelerate delivery and code quality
- Strong Python, Advanced SQL, PySpark or Scala, Unix scripting
- Data orchestration: Airflow, SnapLogic, DBT, or equivalent
- Event bus & streaming: Kafka, AWS EventBridge, SNS/SQS, Kinesis, or similar
- Event-driven architecture: producers, consumers, schema registry, dead-letter queues
- AWS cloud: EC2, EMR, S3, Athena, Glue; Databricks
- Data lake & warehouse: Snowflake, Delta Lake, Redshift, BigQuery
- CI/CD tooling: Git, Jenkins / GitHub Actions, Docker
- Experience with APIs for data exchange and integration
- Data quality mindset, ownership, and SLA awareness
- NoSQL, Neo4j, GraphQL is plus
- Agile/Scrum development experience
- Experience with AI/ML models and feature pipelines
- Exposure to BI platforms (Tableau, Power BI) or data serving for dashboards
- Spark Streaming or Flink for stateful stream processing
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- LE

Data Engineer Intern with Security ClearanceRecently posted
Leidos · Fort Belvoir, VA · Hybrid · Posted 20 Nov 2026 🇺🇸
Prompt EngineeringTechnology$41.6k - $75.2k/yr - DD

Jr. Data EngineerRecently posted
Dexian DISYS · Durham, NC · Hybrid · Posted 20 Nov 2026 🇺🇸
DynamoDBOracleSQL+7TechnologySalary not listed - DO

INFORMATION TECHNOLOGY SPECIALIST (DATA MANAGEMENT) with Security ClearanceRecently posted
Department of Defense · Bremerton, WA · Hybrid · Posted 20 Nov 2026 🇺🇸
SQLData AnalysisLinuxTechnologySalary not listed - MT

Data Engineer (ETL)Recently posted
MHK TECH INC · United States · Hybrid · Posted 20 Nov 2026 🇺🇸
SQLScalaAWS+12TechnologySalary not listed - FA

Data EngineerRecently posted
Factspan Inc · Atlanta, GA · On-site · Posted 20 Nov 2026 🇺🇸
OracleSQLETL+6TechnologySalary not listed - NS
Sr Data EngineerRecently posted
Neural Strategic Solutions, Inc. · Wilmington, MA · Hybrid · Posted 20 Nov 2026 🇺🇸
SQLT-SQLETL+3Technology$70/hr - TE
Data Engineer - Minneapolis, MN, Detroit, MI, Madison, WI, Columbus, OH, Chicago, IL.Recently posted
TechniPros, LLC · Minneapolis, MN · Hybrid · Posted 20 Nov 2026 🇺🇸
SQLApache SparkAWS+8TechnologySalary not listed - DT
Data Engineer (W2 only)Recently posted
Digipulse Technologies, Inc · Durham, NC · Hybrid · Posted 20 Nov 2026 🇺🇸
SQLETLSnowflake+3TechnologySalary not listed - DA

Data EngineerRecently posted
DatamanUSA, LLC · Denver, CO · Hybrid · Posted 20 Nov 2026 🇺🇸
GitETLSnowflake+4TechnologySalary not listed - GF
Senior Data Engineer - W2 (No C2C or 1099) - Onsite in Wilmington, MA (Posted SAM)Recently posted
Global Force USA · Wilmington, MA · Hybrid · Posted 20 Nov 2026 🇺🇸
SQLETLSQL ServerTechnologySalary not listed - PE

Sr. Data Engineer (OBI Advanced Analytic Method Augmentation) with Security ClearanceRecently posted
Prescient Edge · Washington, DC · Hybrid · Posted 18 Nov 2026 🇺🇸
DockerSQLETL+5Technology$160k - $180k/yr - RT

Lead Data EngineerRecently posted
Rapsys Technologies · Columbus, OH · Hybrid · Posted 20 Nov 2026 🇺🇸
Apache SparkAWSETL+7TechnologySalary not listed
