Quick Overview
Job Description
Job Title: Data Engineer with Azure-to-Google Cloud Platform Migration exp
Location:Atlanta, GA
Duration: 6 Months + Extension
Bill Rate: $76/hour
Job Type: C2C/1099 Contract
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD
Job Description :
Design and develop real-time data pipelines using Google Cloud Platform Pub/Sub, Dataflow, and Apache Beam.
Build scalable data ingestion pipelines to process streaming data into BigQuery and Cloud Spanner.
Implement CDC, SCD Type 2, clickstream ingestion, and late-arriving data processing.
Develop and optimize BigQuery SQL queries, partitioning, clustering, and cost management.
Design Cloud Spanner schemas, primary keys, indexes, change streams, and low-latency data access.
Build data synchronization and reverse ETL pipelines between BigQuery and Cloud Spanner.
Migrate existing data pipelines from Microsoft Azure to Google Cloud Platform using Azure Data Factory, Databricks, and Snowflake.
Work with Azure Event Hubs, Cosmos DB, Redis, and Azure Functions during cloud migration projects.
Develop data transformation workflows using Python, SQL, PySpark, Apache Spark, and Delta Lake.
Implement dimensional modeling, Data Vault, medallion architecture, and incremental ETL/ELT processes.
Build customer knowledge graph pipelines, identity resolution, and Customer 360 data solutions.
Develop data feeds for REST, gRPC, and GraphQL APIs, supporting AI applications and MCP servers.
Implement data quality, lineage, governance, and security using Dataplex, Unity Catalog, IAM, and VPC Service Controls.
Automate infrastructure deployment using Terraform, CI/CD, Cloud Run, Dataproc, and Cloud Composer.
Monitor production pipelines, troubleshoot failures, optimize performance and costs, implement testing, and maintain operational SLAs/SLOs.
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law
Similar jobs
- SG
AI Data Engineer
NewSoftware Guidance & Assistance
Rockville, MD🇺🇸On-siteYesterdayLLMPythonTechnology - AM
Lead Data Engineer
NewAmpacity
Atlanta, GA🇺🇸$120k - $130k/yrHybridYesterdayOracleSQLETL+6Technology - CG
Data Engineer with Security Clearance
NewContact Government Services, LLC
Washington, DC🇺🇸$112.6k - $152.8k/yrHybridYesterdaySQLShellETL+7Technology - CL
Data Engineer-ONly W2-NY,NJ
Newcloudingest inc
New York, NY🇺🇸On-siteYesterdaySQLScalaAirflow+3Technology - ZG
Senior Data Engineer
NewZapcom Group
Mountain View, CA🇺🇸$100k - $140k/yrHybridYesterdaySQLAWSPython+1Technology - KA
Data Engineer I
NewKaashTech LLC
Pittsburgh, PA🇺🇸HybridYesterdaySQLScalaAWS+10Technology - YI
Cybersecurity Data Engineer(Cribl/Vector)-W2 only
NewYochana IT Solutions
KS🇺🇸HybridYesterdaySnowflakeSplunkData Pipeline+6Technology - CT
Forward Deployed Engineer — Data Engineering & GenAI
NewCogniSoft Technologies
Washington, DC🇺🇸HybridYesterdayETLGenerative AILLM+2Technology - EI
Senior SQL Server Database Administrator
NewEcho IT Solutions, Inc.
Cary, NC🇺🇸On-siteYesterdaySQLSQL ServerTechnology - TS
Data Engineer
NewTechSpace Solutions Inc.
Milpitas, CA🇺🇸HybridYesterdaySQLDatabricksGenerative AI+1Technology - SC
Data Engineer IV - Marketing & Ads
NewSGS Consulting
United States🇺🇸Hybrid9 hours agoSQLPythonTechnology - TE
Snowflakes data engineer
NewTeachercool
Washington, DC🇺🇸HybridYesterdaySQLSQL ServerAWS+4Technology