Quick Overview
Seniority
Mid Senior
Work mode
Remote
Location
United States
Posted
1 week ago
SQLAWSApacheApache Spark
Job Description
Job Title: AWS Data Engineer
Job Location: Remote
Onboarding: In-person onboarding required in NJ or San Jose, CA
Job Duration: Full Time
Role Overview
Seeking a hands-on Data Engineer with strong expertise in Spark-based data platforms, Apache Iceberg, and AWS Data Lake technologies. The role will focus on large-scale Delta-to-Iceberg migration initiatives and implementation of fine-grained governance controls in enterprise data lake environments.
Key Responsibilities
· Design and execute Delta Lake to Apache Iceberg migration strategies.
· Develop and optimize Spark/PySpark data processing pipelines.
· Implement Fine-Grained Access Control (FGAC) capabilities.
· Configure and manage Row-Level Security (RLS) and Column-Level Security (CLS).
· Work with AWS Lake Formation to enable governed data access.
· Analyse Iceberg internals and optimize table performance.
· Support data governance, security, and compliance initiatives.
· Troubleshoot and resolve data platform performance issues.
Required Skills
· Data Engineering experience.
· Strong hands-on experience in Apache Spark / PySpark.
· Deep knowledge of Apache Iceberg internals.
· Experience with Delta-to-Iceberg migration at scale.
· Strong AWS Data Lake experience.
· Hands-on AWS Lake Formation expertise.
· Experience implementing FGAC controls.
· Strong understanding of RLS and CLS concepts.
· Strong SQL and data modelling skills.
· Experience working in enterprise data governance environments.
· Familiarity with GDC.
Preferred Skills
· AWS S3
· Data Lake architecture
· Performance tuning
· Infrastructure automation and CI/CD
· Metadata and governance frameworks
AWS Data Engineer1AWS,Migration,Pyspark,Datalake,ICEBREGN/AFull TImeUnited States
Similar jobs
- GO
Database Engineer
NewGovCIO
United States🇺🇸$130k - $160k/yrRemoteYesterdayOracleSQLDatabricks+2Technology - RD
Data Engineering Technical Lead
Randstad Digital
San Diego, CA🇺🇸$130k - $150k/yrHybrid2 months ago401kSQLScala+11 - RD
Data Engineering Manager
NewRandstad Digital
San Diego, CA🇺🇸$150k - $180k/yrOn-siteYesterday401kSQLSQL Server+12 - PG
Data Engineer, Onsite - 70007
NewPRIMUS Global Services Inc.
Austin, TX🇺🇸On-siteYesterdaySQLETLSnowflake+2Technology - AS
Quantitative Data Engineer (Market Data)
NewAmtex Systems Inc.
Morristown, NJ🇺🇸On-siteYesterdaySQLSQL ServerETL+2Technology - IN
FHIR Data Engineer
NewIntone Networks Inc.
United States🇺🇸HybridYesterdaySQLScalaAWS+4Technology