Back to Jobs
Recently postedTechnology

Principal Data Engineer (Azure to AWS Migration) Houston, TX Only on w2

BURGEON IT SERVICES LLCHouston, TX🇺🇸United States

Quick overview

SeniorityLeader
Work modeOn Site
LocationHouston, TX, United States
SQLApache SparkAWSApacheDatabricksUnityAzurePostgreSQLSQL ServerAzure Data FactoryDelta LakeIAM

Job description

Job Title: Principal Data Engineer (Azure to AWS Migration)
Location: Houston, TX 77072
Duration: 12 months plus
Experience: 7–10 Years (10 Years preferred)
Work Mode: Onsite / Hybrid
Domain: Oil & Gas

Please send your updated resume to pranayatburgeonitsdotcom
Job Description
We are looking for an experienced Principal Data Engineer with strong hands-on experience in Azure-to-AWS data platform migration. The candidate will lead the migration of existing Azure data services to AWS, including data pipelines, data lakes, Databricks workloads, and databases.
Mandatory Skills
  • Strong experience in Azure-to-AWS Data Platform Migration.
  • Azure Data Factory (ADF), ADLS Gen2 and Azure Databricks.
  • AWS S3, AWS Glue, Step Functions, Lambda, EventBridge and IAM.
  • Databricks, Apache Spark, PySpark, Spark SQL and Delta Lake.
  • Databricks Workflows/Jobs and Unity Catalog.
  • Hands-on experience migrating Databricks workloads from Azure to AWS.
  • SQL Server to PostgreSQL / Amazon Aurora PostgreSQL migration.
  • Amazon Aurora PostgreSQL and AWS Database Migration Service (DMS).
  • SQL Server and PostgreSQL database architecture, stored procedures, indexing and performance tuning.
  • Data modeling: Conceptual, Logical and Physical Data Models; ER/Studio.
  • Database migration: Schema conversion, CDC, bulk loading, data reconciliation, cutover, rollback and stabilization.
  • Enterprise Data Architecture, Data Governance, Security and Performance Optimization.
  • Strong technical leadership and experience managing enterprise migration projects.

Similar jobs