Why this role stands out
This hybrid role offers a fantastic opportunity to shape enterprise data solutions using cutting-edge Databricks and AWS technologies, perfect for a mid-senior architect who thrives on complex data modeling and clear communication. You'll contribute to a reputable company while developing your skills in a flexible environment.
Quick overview
Job description
NewGen is seeking a Sr. Data Engineer with experience building enterprise data solutions in both Databricks (Unity Catalog, Hive Metastore) and AWS (AWS Glue, S3, RDS) and managing a data warehouse.
Required:
- 8+ years of experience in designing, developing, deploying, and managing ETL processes and data pipelines utilizing comprehensive logging and robust error handling mechanisms to troubleshoot and resolve issues.
- 3+ years of hands-on experience building, debugging, and optimizing data pipelines using Databricks notebooks, clusters, and job orchestration tools using Databricks tools that include Delta Lake, Databricks Delta, and Unity Catalog.
- 3+ years of hands-on experience writing Python and PySpark code for ETL scripts and custom transformations.
- Experience in data modeling (e.g. understanding when to use dimensional vs relation data models) within a medallion architecture (Bronze, Silver, Gold).
- Experience using various AWS services, including AWS Glue, Amazon S3, Amazon RDS.
- Ability to design and implement data models, from initially defining schemas to optimizing data structures that support efficient queries and analytics.
- Knowledge of performance optimization techniques for ETL jobs, such as partitioning, bucketing, caching, and troubleshooting to improve query performance.
- Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
- Bachelor’s degree in Computer Science, Computer Engineering, Engineering, Math, Physics, or Information Systems / Technology.
Similar jobs
- CA
Data Designer
Carrier · Atlanta, GA · Hybrid 🇺🇸
RecruitingFigmaTableau+7$79k - $158k/yr - BR

Data Engineer/ArchitectRecently posted
Blue Rose Technologies LLC · Fremont, CA · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLApache SparkETL+3TechnologySalary not listed - MA

Snowflake AdminRecently posted
Magicforce · United States · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLGitAWS+7TechnologySalary not listed - ID
Sr AWS Data Engineer (with ETL, Python, AWS Glue, Lambda, Node.js & Microservices exp)Recently posted
Info Dinamica Inc · Malvern, PA · On-site · Posted 16 Nov 2026 🇺🇸
DynamoDBMicroservicesOracle+18TechnologySalary not listed - PG

Data Engineer – Databricks, PySpark, Cloud | Hybrid - 71701Recently posted
PRIMUS Global Services Inc. · Princeton, NJ · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLScalaApache Spark+4TechnologySalary not listed - PH

Data EngineerRecently posted
Photon · Sunnyvale, CA · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLAWSETL+6TechnologySalary not listed - GE

SQL Server DBARecently posted
Genesis10 · Charlotte, NC · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLShellMicrosoft Office+3Technology$53 - $61/hr - NT
Oracle DBA with Security ClearanceRecently posted
NorthHill Technology Resources · Fairfax, VA · Hybrid · Posted 17 Nov 2026 🇺🇸
MariaDBMongoDBOracle+6TechnologySalary not listed - IT

ETL LeadRecently posted
ITSYNTAX INC · Dallas, TX · Hybrid · Posted 16 Nov 2026 🇺🇸
OraclePL/SQLSQL+6Salary not listed - FA

Systems Engineer (Data Flow/NiFi) Level 2Recently posted Auto Apply
Fantom Corporation · Fort Meade · On-site · Posted 17 Nov 2026 🇺🇸
ApacheComplianceComputer Vision+5TechnologySalary not listed - LS

Senior Database EngineerRecently posted
London Stock Exchange Group · St Louis, MO · Hybrid · Posted 17 Nov 2026 🇺🇸
OracleShellAWS+5TechnologySalary not listed - KT

Senior Data EngineerRecently posted
Kforce Technology Staffing · Atlanta, GA · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLETLAirflow+5TechnologySalary not listed
