Google Cloud Platform DATA Platform Engineer in Charlotte, NC (Onsite)-Contract
Quick Overview
Job Description
Title : Google Cloud Platform DATA Platform Engineer
Location: Charlotte, NC
Onsite
Job Type: Contract
About The Role
We are building a hybrid data platform that bridges an On-premises big data cluster with Google Cloud Platform and we need an engineer who can own this integration end to end This role is central to establishing a repeatable production grade pattern for multitenant data platform architecture starting with Google Cloud Platform as the first cloud tenant on an existing on-prem Cloudera cluster You will configure the foundational infrastructure service accounts Iceberg table formats metadata catalog integration via Apache Gravitino and role-based access controls
Key Responsibilities
- Configure and provision the On-premises Cloudera cluster environment including service account creation role definitions and permission structures for multitenant access
- Design and implement Apache Iceberg table structures optimized for hybrid on Prem cloud workloads
- Integrate the Iceberg REST Catalog IRC with Apache Gravitino to establish a unified metadata layer across on-prem and Google Cloud Platform environments
- Establish Google Cloud Platform as a production tenant on the existing on prem Cloudera cluster validating the end-to-end architecture pattern
- Define and enforce data access governance including role-based permissions and service account security policies across both environments
- Drive the full lifecycle from environment setup through to production deployment
- Publish comprehensive documentation and architectural blueprints covering cross platform interoperability best practices vendor recommendations and access patterns for hybrid data lake implementations
Requirements
- 5 years of relevant experience in data platform engineering
- Handson experience with Google Cloud Platform Google Cloud Platform
- Experience with On-premises Cloudera big data clusters
- Experience with Apache Iceberg table format
- Experience with Iceberg REST Catalog IRC
- Experience with Apache Gravitino for metadata catalog integration
- Experience with service account creation and rolebased access control in hybrid environments
Skills Required
Google Cloud Platform ,Cloudera Apache Iceberg Iceberg REST Catalog Apache Gravitino Service Account Management RoleBased Access Control Hybrid Data Platform Architecture MultiTenant Data Platform
Experience 5 Years
From the Client
- Setup DPC environment create a service account Iceberg tables IRC with Gravitino DPC roles and permissions existing DPC cluster with Google Cloud Platform as one of the tenants to establish this pattern and take it all the way to production
- Setup Google Cloud Platform environment create a service account Iceberg tables IRC Google Cloud Platform IAM roles and permissions existing Google Cloud Platform project GDWdev4 project to establish this pattern and take it all the way to production
- Get IRC from DPC and Google Cloud Platform to sync with each other it can be one or more IRC from DPC and Google Cloud Platform
- DPC and Google Cloud Platform platform should have the ability
- Establish the pattern on interoperability for data access between DPC and Google Cloud Platform for Iceberg tables
- Put the governance and guardrails around this access patterns and persona mapping on Google Cloud Platform side
- Publish document and blueprints on this cross platform interoperability best practices vendor recommendations and access patterns
Similar jobs
- PN
Senior Staff DevOps Engineer
PaloAlto Networks
CA🇺🇸$126k - $203.5k/yrOn-site3 weeks agoMicroservicesMySQLOracle+12Technology - NG
Sr Principal Infrastructure Product Owner DevOps (AHT) with Security Clearance
Northrop Grumman
Aurora, CO🇺🇸$135.8k - $213.4k/yrOn-site6 days agoDockerExpressAWS+10Technology - AT
Senior VKS / Tanzu Kubernetes /DevOps Engineer_ Seattle WA
NewAce Technologies, Inc.
Seattle, WA🇺🇸Hybrid20 hours agoShellAnsibleGitHub Actions+4Technology - PC
Azure Cloud/Platform Engineer (exp in Azure Networking, Terraform)
NewPyramid Consulting, Inc.
Irving, TX🇺🇸$70 - $75/hrOn-site20 hours agoPackerAWSEmbedded Systems+6Technology - BO
Senior Site Reliability Engineer
NewBoeing
Saint Louis, Missouri🇺🇸$160.7k - $217.3k/yrOn-site29 minutes agoDockerAWSSonarQube+9Technology - TE
SRE Architect
TechVirtue LLC
Phoenix, AZ🇺🇸Hybrid1 week agoMicroservicesOracleSpring+12Technology