Haystack
← Back to Jobs
Technology
PTPrudent Technologies and Consulting logo

Google Cloud Platform Data Platform Engineer

Prudent Technologies and ConsultingUnited States🇺🇸United StatesPosted Oct 14, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
United States
Posted
20 hours ago
SQLAirflowApacheBigQueryGoogle CloudJavaJenkinsPythonTerraform

Job Description

Job Title- Google Cloud Platform Data Platform

Job Location- USA (Remote)

 

Job Description-

Administer, configure, maintain and upgrade Google Cloud Platform Composer (Apache Airflow) environment ( Mandatory )

• Design and implement infrastructure as code using Terraform for provisioning and managing Google Cloud Platform resources. (Mandatory)

• Able to create Terraform modules and publish same in TFE (Terraform Enterprise )

• DAG deployment, Troubleshooting, performance tuning, and operational support.

• Support and optimize Dataflow and Dataproc workloads, including batch and streaming data processing pipelines.

• Maintain Google Cloud Platform infrastructure including services like:

o Google Cloud Platform Composer (Apache Airflow)

o Google Cloud Storage (GCS)

o BigQuery (BQ)

o Cloud Dataflow /Apache Beam

o Cloud Dataproc

o Cloud Functions --- (Mandatory)

o Cloud Run

o Pub/Sub

o Cloud SQL

o Secret Manager

o Logging & Monitoring

• Monitor Google Cloud Platform usage and quotas, and proactively prevent quota-related issues.

• Set up and manage alerting by Creating Alert policies in Google Cloud Platform Monitoring . (Mandatory)

• Manage CI/CD pipelines using Jenkins and/or using other CI/CD tools.(Mandatory)

• Able to request Identity and Access Management (IAM) permissions, service accounts, and security policies following least-privilege principles.

• Ensure security, compliance, and cost-efficiency across the cloud environment.

• Monitor cloud infrastructure health, performance, and resource utilization using Cloud Monitoring, Cloud Logging, Error Reporting, and Cloud Trace.

• Develop automation scripts and operational tools using Python and/or Java to improve platform efficiency and reduce manual effort.

• Create and maintain operational documentation, runbooks, architecture diagrams, standard operating procedures (SOPs), and platform best practices.

• Excellent problem-solving and troubleshooting skills.

Nice to Have Skills:

• Experience with CDC platforms such as Striim

• Experience with ServiceNow integrations and operational workflows

• Knowledge of FinOps, cloud cost optimization, and governance frameworks

• Networking components understanding including:

o VPCs and Shared VPCs

o VPC Connectors

o Firewall Rules

o CIDR Ranges

• Exposure to healthcare domain.

Similar jobs