Google Cloud Platform DATA PLATFORM ENGINEER

Job Overview:

Pay Range: $65hr - $70hr

Requirement/Must Have:

• 5+ years of relevant experience in data platform engineering.
• Hands-on experience with Google Cloud Platform (Google Cloud Platform).
• Experience with on-premises Cloudera big data clusters.
• Experience with Apache Iceberg table format.
• Experience with Iceberg REST Catalog (IRC).
• Experience with Apache Gravitino for metadata catalog integration.
• Experience with service account creation and role-based access control in hybrid environments.

• Configure and provision the on-premises Cloudera cluster environment including service account creation, role definitions, and permission structures for multi-tenant access.
• Design and implement Apache Iceberg table structures optimized for hybrid on-premises and cloud workloads.
• Integrate the Iceberg REST Catalog (IRC) with Apache Gravitino to establish a unified metadata layer across on-premises and Google Cloud Platform environments.
• Establish Google Cloud Platform as a production tenant on the existing on-premises Cloudera cluster, validating the end-to-end architecture pattern.
• Define and enforce data access governance including role-based permissions and service account security policies across both environments.
• Drive the full lifecycle from environment setup through to production deployment.
• Publish comprehensive documentation and architectural blueprints covering cross-platform interoperability best practices, vendor recommendations, and access patterns for hybrid data lake implementations.
• Setup DPC environment, creating service accounts, Iceberg tables, and IRC with Gravitino roles and permissions.
• Setup Google Cloud Platform environment, creating service accounts, Iceberg tables, and Google Cloud Platform IAM roles and permissions to establish production patterns.
• Synchronize IRC from DPC and Google Cloud Platform to ensure metadata consistency.
• Establish patterns for interoperability for data access between DPC and Google Cloud Platform for Iceberg tables.
• Implement governance and guardrails around access patterns and persona mapping on the Google Cloud Platform side.

• Google Cloud Platform.
• Cloudera.
• Apache Iceberg.
• Iceberg REST Catalog.
• Apache Gravitino.
• Service Account Management.
• Role-Based Access Control.
• Hybrid Data Platform Architecture.
• Multi-Tenant Data Platform.

• 5+ years of experience in data platform engineering.