Back to Jobs
Recently postedTechnology

Lead Data Engineer

Kanshe InfotechHouston, TX🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationHouston, TX, United States
GitApache SparkAWSAPI GatewayETLAirflowApacheCDKPythonIAM

Job description

AWS DATA Lead
Location- Houston
Experience- 10+ years overall, including 4+ years leading data platform delivery


About the role:

We are looking for a hands-on technical lead who can hold design authority on an enterprise AWS data lakehouse and build on it personally. The person in this seat writes production code, authors the architecture that the team builds to, owns the governance and security model, and prototypes new AI capability directly.

Required skills and experience:
•10+ years in technology delivery, including 4+ years as a technical lead, architect, or senior engineer on data platform or data engineering programs.
•Deep, hands-on AWS experience: S3, S3 Tables, Glue, Athena, Lambda, Step Functions, DMS, Lake Formation, IAM, API Gateway, CloudFront, Secrets Manager, CloudWatch, and ECR. You should be able to read CloudTrail and resolve an access-denied path unaided.
• Apache Iceberg: practical working knowledge of table formats, catalogs, and engine compatibility.
• AWS CDK (Python): you build and maintain infrastructure as code as a matter of course.
• Python at production standard: Lambda handlers, PySpark ETL, CDK stacks, and test suites that you write and review, not merely read.
• Orchestration with Airflow or MWAA.
• Enterprise access control at scale: RBAC and ABAC models, fine-grained filtering, identity federation, and the operational reality of managing grants across many principals and resources.
• Experience leading distributed engineering teams across time zones, with Git and disciplined commit and review practice.

Similar jobs