Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
Austin, TX, United States
Posted
20 hours ago
SQLAWSAirflow
Job Description
Role :- AWS Data Engineer
Location : Austin TX (Hybrid)
Full-Time
- 14+ years of hands-on data engineering experience building production data pipelines, not just supporting or maintaining them.
- Proven experience designing and owning end-to-end data pipelines across ingestion, transformation, storage, and consumption layers.
- Strong experience with AWS-native data stack including S3, Glue (PySpark), Athena, and orchestration tools such as Airflow or Step Functions.
- Experience building automated data quality checks into pipelines, such as validation rules, reconciliation logic, and anomaly detection.
- Strong understanding of data modeling and storage design including partitioning strategies, file sizing, and handling of small files.
- Deep, hands-on data modeling expertise, with solid grounding in data modeling concepts (dimensional modeling, normalization, slowly changing dimensions, fact/dimension design) and the ability to independently apply them to design data models and schemas for new datasets, including resolving grain or structural differences between source and target systems.
- Direct, end-to-end ownership experience with data quality frameworks, defining validation rules, thresholds, and exception handling, not just operating within a framework someone else built.
- Demonstrated experience defining testing standards for data pipelines and leading their adoption across a team.
- Experience making architectural decisions and trade-offs, such as choosing between Glue, Lambda, EMR or container-based approaches based on use case.
- Solid experience with PySpark and SQL including performance tuning and optimization in distributed processing environments.
- Experience building reliable, production-grade pipelines including error handling, retries, and monitoring.
- Experience reconciling and validating data across source and target systems to identify discrepancies and drive sign-off before production release.
Similar jobs
- IS
Data Architect / Senior Staff Data Engineer
NewiCUBE Solutions
Oakland, CA🇺🇸On-site20 hours agoSQLETLBigQuery+3Technology - BI
AWS Data Engineer Greenwood Village, CO_hybrid H1B and w2 or c2c F2F
NewBURGEON IT SERVICES LLC
Greenwood Village, CO🇺🇸On-site20 hours agoSQLScalaAWS+6Technology - ML
Software/Data Engineer with Security Clearance
NewMIT Lincoln Laboratory
Lexington, MA🇺🇸$116.4k - $140k/yrHybrid20 hours agoMySQLSQLAWS+6Technology - RT
Azure Databricks / Python Data Engineer
NewRapsys Technologies
Fort Worth, TX🇺🇸Hybrid20 hours agoSQLETLAgile+11Technology - IT
ETL DataStage Consultant
NewITBMS Inc.
Culver City, CA🇺🇸On-site20 hours agoSQLShellETL+3 - VS
F2F Data Engineer ||Okemos, MI (Hybrid)
NewVerito Solutions
Okemos, MI🇺🇸Hybrid20 hours agoOraclePL/SQLSQL+4Technology