Google Cloud Platform Data Engineer
Quick Overview
Job Description
Data Engineer with Cloud Migration experience
Location: Fully Remote (US preferred, Canada-based candidates are also welcome)
Contract Duration: Through the end of the year with strong possibility of extension
Level: Strong Mid-Level to Senior
Required Skills
Strong SQL
Cloud migration experience
Google Cloud Platform (Google Cloud Platform)
Database administration and/or data engineering background
Overview
We're looking for a Data Engineer to design and maintain data pipelines that move and transform data across AWS and Google Cloud Platform environments, with a strong emphasis on PostgreSQL and Cloud SQL. This role centers on building a pipeline that ingests streaming data from AWS Firehose, stages it in GCS, loads it into Cloud SQL (PostgreSQL), applies data masking, and delivers clean data into BigQuery for analytics.
Key Responsibilities
Design, build, and maintain ETL/ELT pipelines using Dataflow, Dataproc, and Airflow (Cloud Composer) for orchestration
Build and manage data ingestion from AWS Firehose into Google Cloud Storage (GCS)
Load and manage relational data in Cloud SQL (PostgreSQL), including schema design, performance tuning, and query optimization
Implement data masking/anonymization using Cloud DLP to protect sensitive data prior to downstream use
Load masked/transformed data into BigQuery for analytics and reporting consumption
Use Datastream for change data capture (CDC) and database replication where applicable
Monitor pipeline health, troubleshoot failures, and optimize for reliability and cost
Collaborate with data analysts, architects, and security/compliance teams to ensure data governance standards are met
Required Skills & Experience
Hands-on experience with Google Cloud Platform data services: Dataflow, Dataproc, Cloud Composer/Airflow, BigQuery, Cloud SQL, Datastream
Strong PostgreSQL experience schema design, query optimization, administration
Experience with Cloud DLP (or equivalent data masking/anonymization tools)
Experience working with AWS services, particularly Kinesis Data Firehose, and cross-cloud data movement (AWS GCS)
Solid understanding of ETL/ELT design patterns, batch and streaming data processing
Proficiency in Python and/or SQL for pipeline development
Familiarity with data governance, security, and compliance practices (PII handling, masking)
Nice to Have
Experience with Terraform or other IaC tools for provisioning Google Cloud Platform resources
Experience with CI/CD pipelines for data engineering workflows
Background in SAP data extraction/integration
Skills
Similar jobs
Cloud Automation Engineer
GovCIO · United States
2 minutes ago$110k - $135k/yrLead Cloud Automation Engineer
Apex Systems · Columbus, United States
19 minutes ago$60 - $70/hrSystems Engineer - JobID-0209 with Security Clearance
Innovative Defense Technologies · San Diego, United States
20 minutes ago$90k - $150k/yrSenior AWS Cloud Engineer - W2 Only
ASCII Group LLC · San Diego, United States
41 minutes ago€60/hrGoogle Cloud Platform Data engineering
Spiceorb · Bentonville, United States
41 minutes agoAWS Cloud Architect – Melbourne, Florida - Full Time Only
GD Resources LLC · Melbourne, United States
42 minutes ago$170k - $210k/yr