Principal Data Engineer / Data Architect – AWS & Google Cloud Platform

Job Overview

We are seeking highly experienced Lead Data Engineers, Principal Data Engineers, and Data Architects with 15+ years of experience designing, developing, and implementing enterprise-scale data engineering solutions across AWS and Google Cloud Platform (Google Cloud Platform).

The ideal candidate will have extensive experience in cloud data architecture, large-scale data processing, distributed computing, data pipeline development, and technical leadership.

We offer H-1B transfer sponsorship for eligible candidates and sponsorship, including I-140 processing support, subject to company policy, eligibility, and applicable immigration requirements.

Key Responsibilities

• Lead the architecture, design, development, and implementation of scalable enterprise data platforms.

• Design and build robust data pipelines for batch and real-time data processing.

• Architect cloud-native data solutions using AWS and/or Google Cloud Platform (Google Cloud Platform).

• Develop and optimize ETL/ELT pipelines, data ingestion frameworks, and data transformation workflows.

• Lead data platform modernization and migration initiatives from on-premises environments to cloud platforms.

• Establish data architecture standards, data governance practices, security controls, and data quality frameworks.

• Work with business stakeholders, data scientists, analytics teams, and engineering teams to deliver business-critical data solutions.

• Drive technical design reviews, code reviews, performance tuning, and engineering best practices.

• Mentor data engineers and provide technical guidance to distributed engineering teams.

• Optimize cloud infrastructure, data processing performance, scalability, and operational costs.

• Lead technical discussions around data modeling, data warehousing, data lakes, and lakehouse architecture.

Required Technical Skills

• 15+ years of overall IT experience, with significant hands-on experience in data engineering and architecture.

• Strong programming skills in Python, SQL, and/or Scala.

• Extensive experience building enterprise-grade ETL/ELT pipelines and distributed data processing solutions.

• Strong experience with AWS data services such as:

  • Amazon S3

  • AWS Glue

  • Amazon Redshift

  • Amazon EMR

  • AWS Lambda

  • Amazon Kinesis

• Strong experience with Google Cloud Platform data services such as:

  • BigQuery

  • Dataflow

  • Dataproc

  • Cloud Storage

  • Pub/Sub

  • Cloud Composer

• Experience with Apache Spark, PySpark, Kafka, and distributed processing frameworks.

• Expertise in data modeling, data warehousing, data lakes, and modern data platform architecture.

• Strong understanding of cloud security, IAM, encryption, governance, and performance optimization.

• Experience leading technical teams, defining architecture standards, and delivering complex enterprise projects.

• Excellent communication, analytical, and stakeholder management skills.

Preferred Qualifications

• Experience designing and implementing multi-cloud or hybrid-cloud data architectures across AWS and Google Cloud Platform.

• Knowledge of Databricks, Snowflake, Delta Lake, or lakehouse architecture.

• Experience with Terraform, infrastructure as code, CI/CD, and automated deployment pipelines.

• Experience with real-time streaming, event-driven architecture, and large-scale data processing.

• Exposure to data governance, metadata management, data lineage, and data quality tools.

• Experience integrating data platforms with AI/ML, advanced analytics, and GenAI solutions.

• Prior experience as a Lead Data Engineer, Principal Data Engineer, Data Engineering Manager, or Data Architect.

Immigration and Career Support

We welcome qualified H-1B professionals seeking long-term career opportunities.

• H-1B transfer sponsorship for eligible candidates.

• sponsorship and I-140 processing support, subject to company policy and eligibility.

• Long-term career growth and technical leadership opportunities.

• Transparent communication regarding employment terms and immigration processes.

Ideal Candidate Profile

Candidates with extensive experience in enterprise data platforms, cloud data engineering, and technical architecture are encouraged to apply.Candidates must have valid U.S. work authorization and be eligible for the proposed employment and immigration arrangements.