Haystack
← Back to Jobs
Technology
QT

Data Engineer with Azure-to-Google Cloud Platform Migration exp

QUANTUM TECHNOLOGIES LLCAtlanta, GA🇺🇸United StatesPosted Oct 12, 2026

Quick Overview

Salary
$76/hr
Seniority
Mid Senior
Work mode
Hybrid
Location
Atlanta, GA, United States
Posted
Yesterday
SQLETLSnowflakeApacheApache SparkAzureBigQueryDatabricksGoogle CloudGraphQLPythonRESTRedisTerraformUnityVaultgRPC

Job Description

Job Title: Data Engineer with Azure-to-Google Cloud Platform Migration exp
Location:Atlanta, GA
Duration: 6 Months + Extension
Bill Rate: $76/hour
Job Type: C2C/1099 Contract
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD
Job Description :

  • Design and develop real-time data pipelines using Google Cloud Platform Pub/Sub, Dataflow, and Apache Beam.

  • Build scalable data ingestion pipelines to process streaming data into BigQuery and Cloud Spanner.

  • Implement CDC, SCD Type 2, clickstream ingestion, and late-arriving data processing.

  • Develop and optimize BigQuery SQL queries, partitioning, clustering, and cost management.

  • Design Cloud Spanner schemas, primary keys, indexes, change streams, and low-latency data access.

  • Build data synchronization and reverse ETL pipelines between BigQuery and Cloud Spanner.

  • Migrate existing data pipelines from Microsoft Azure to Google Cloud Platform using Azure Data Factory, Databricks, and Snowflake.

  • Work with Azure Event Hubs, Cosmos DB, Redis, and Azure Functions during cloud migration projects.

  • Develop data transformation workflows using Python, SQL, PySpark, Apache Spark, and Delta Lake.

  • Implement dimensional modeling, Data Vault, medallion architecture, and incremental ETL/ELT processes.

  • Build customer knowledge graph pipelines, identity resolution, and Customer 360 data solutions.

  • Develop data feeds for REST, gRPC, and GraphQL APIs, supporting AI applications and MCP servers.

  • Implement data quality, lineage, governance, and security using Dataplex, Unity Catalog, IAM, and VPC Service Controls.

  • Automate infrastructure deployment using Terraform, CI/CD, Cloud Run, Dataproc, and Cloud Composer.

  • Monitor production pipelines, troubleshoot failures, optimize performance and costs, implement testing, and maintain operational SLAs/SLOs.

Equal Opportunity Employer:
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law

 

Similar jobs