Cloud Platform Engineer

Cloud Platform Engineer

Position: Cloud Platform Engineer
Location: NJ

About the Role:
We are seeking a skilled Cloud Platform Engineer to design, build, and operate secure, scalable cloud platforms that support cutting-edge GenAI, LLM, and RAG workloads. In this role, you will be instrumental in enabling MLOps/LLMOps pipelines, implementing platform engineering best practices, and ensuring the reliability and performance of our GenAI services. You will collaborate closely with data scientists, ML engineers, and application teams to bring advanced AI models into production.

Key Responsibilities:

• Design, build, and operate secure, scalable Google Cloud Platform and OpenShift (OCP/GKE) platforms to support deployment of GenAI models, LLMs, and RAG workloads.

• Provision and manage cloud infrastructure using Terraform, including landing zones, networking, org policies, and hybrid connectivity across Google Cloud Platform and Azure.

• Enable MLOps/LLMOps pipelines for model deployment, monitoring, and lifecycle management, integrating Arize AI and GenAI platforms.

• Implement platform engineering best practices, including Kubernetes-based abstractions, internal developer portals, and self-service environments.

• Ensure platform security, governance, and secrets management using HashiCorp Vault, IAM, and policy-as-code.

• Establish observability, SLOs, and SRE practices to ensure reliability and performance of GenAI and platform services.

• Collaborate with data scientists, ML engineers, and application teams to onboard new LLMs, APIs, and inference services efficiently.

Required Technical Skills:

• Cloud Platforms: Google Cloud Platform, Azure

• Infrastructure as Code: Terraform

• Cloud Architecture: Cloud Networking, Landing Zones, Org Policy / Governance, Hybrid Connectivity

• Security & Secrets: HashiCorp Vault, IAM, Policy-as-Code

• Containerization & Orchestration: Kubernetes, GKE, OpenShift (OCP)

• Platform Engineering: Internal Developer Portals, Self-Service Environments

• Observability & Reliability: Observability, SRE / SLOs

• GenAI & MLOps: GenAI Platforms, LLMs, RAG, MLOps/LLMOps, Arize AI

• Programming: Python

• Tools: Claude Cowork