Quick overview
Job description
Principal AI Architect
Remote role
Role Summary:
This role combines hands-on forward deployment with ownership of AI architecture. You will define the reference architecture for Client’s AI Center of Excellence (CoE), built around an AI plane on Google Cloud, and work directly with business and engineering teams to put AI systems into production with measurable business impact.
Key Responsibilities:
Architecture and strategy
- Define and maintain the enterprise AI reference architecture and AI plane, covering model access, retrieval, agent orchestration, evaluation, guardrails, observability, and governance.
- Develop and execute an AI CoE roadmap aligned with business objectives, supported by architecture decision records, reusable patterns, and reference implementations.
Delivery
- Embed with business and engineering teams to scope, prototype, and deploy LLM and agentic solutions into production.
- Lead the end-to-end lifecycle of AI projects: data engineering, model or prompt development, testing, and deployment on Google Cloud Platform.
- Design AI solutions for predictive analytics, intelligent automation, and real-time decision systems (e.g., BigQuery, Pub/Sub, Dataflow).
Infrastructure and MLOps
- Build and optimize infrastructure for LLM serving, fine-tuning, and distributed training on GPUs and TPUs.
- Implement MLOps for model deployment, monitoring, and lifecycle management.
Responsible AI and governance
- Establish evaluation harnesses, guardrails, and responsible AI controls covering bias, fairness, security, and regulatory compliance.
- Partner with security, legal, and compliance teams on AI risk assessment, data residency, and governance.
- Enablement
- Enable internal teams through standards, templates, runbooks, and training so they can operate and extend AI solutions independently.
- Mentor engineers and foster collaboration between AI teams and cross-functional departments.
Required Qualifications:
- 8+ years in software engineering, solution architecture, or AI/ML delivery, including 3+ years deploying LLM or AI systems to production.
- Hands-on experience with Google Cloud Platform (Vertex AI, GKE or Cloud Run, BigQuery); working familiarity with AWS or Azure.
- Deep knowledge of transformer-based models, LLMs, retrieval-augmented generation, and multimodal AI, with hands-on use of PyTorch, TensorFlow, or JAX.
- Experience with MLOps and with GPU/TPU-based training or serving infrastructure.
- Proven track record of designing AI reference architectures or platforms and deploying AI systems with measurable business impact.
- Ability to present architecture artifacts to executive audiences.
- Strong Python skills and experience integrating enterprise APIs and data sources.
Preferred Qualifications:
- Google Cloud Professional Cloud Architect or Professional Machine Learning Engineer certification.
- Experience establishing an AI CoE, AI governance model, or AI operating model.
- Computer vision experience.
- Familiarity with NIST AI RMF, ISO/IEC 42001, and the EU AI Act.
- Telecom or network infrastructure background.
Tech Stack (representative):
- Python, Google Cloud Platform, Vertex AI, BigQuery, GKE, Cloud Run, Pub/Sub, Dataflow, PyTorch, RAG frameworks (e.g., LangChain, LlamaIndex), MCP, Terraform
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- LI

Agentic AI EngineerRecently posted
LiveMindz · Los Angeles, CA · Hybrid · Posted 18 Nov 2026 🇺🇸
AWSPythonNode.jsTechnologySalary not listed - IT
Agentic AI Developer locals to NY/NJ F2FRecently posted
ISite Technologies Inc · New York, NY · Hybrid · Posted 14 Nov 2026 🇺🇸
LLMPythonPrompt Engineering+1TechnologySalary not listed - VI

GenAI Developer/Lead/Architect (Exp-10 Y)-Full time-HybridRecently posted
Visionary Innovative Technology Solutions · Irvine, CA · Hybrid · Posted 18 Nov 2026 🇺🇸
DockerFastAPIMicroservices+17TechnologySalary not listed - HC

Senior & Principal Applied AI Engineer (Agentic Workflows / Autonomous Systems)Recently posted
High Country Search Group · Denver, Colorado · Hybrid · Posted 18 Nov 2026 🇺🇸
Next.jsGenerative AINode.js+4Technology$225k - $350k/yr - RI
Gen AI EngineerRecently posted
Raas Infotek LLC · United States · Hybrid · Posted 18 Nov 2026 🇺🇸
DockerFastAPIFlask+25TechnologySalary not listed - TT
Founding AI Agent EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 18 Nov 2026 🇺🇸
RecruitingClinical TrialsOutreach+2$150k - $220k/yr - TT
Founding AI EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 18 Nov 2026 🇺🇸
Next.jsLLMPlaywright+2Technology$216k - $250k/yr - VD

AI Engineer/Forward Deployed EngineerRecently posted
VDart, Inc. · Juno Beach, FL · On-site · Posted 18 Nov 2026 🇺🇸
DockerGitAWS+10TechnologySalary not listed - OR

AI EngineerRecently posted
Oriontek Inc · United States · Remote · Posted 17 Nov 2026 🇺🇸
Generative AITechnologySalary not listed - AS
AI Applications EngineerRecently posted
Apex Systems · Jersey City, NJ · On-site · Posted 18 Nov 2026 🇺🇸
MongoDBNext.jsLLM+9Salary not listed - AS
Senior AI EngineerRecently posted
Apex Systems · Seattle, WA · Remote · Posted 18 Nov 2026 🇺🇸
SQLETLMLOps+13Technology$100 - $130/hr - SS
AI ArchitectRecently posted
SDH Systems · United States · On-site · Posted 18 Nov 2026 🇺🇸
.NETRESTPrompt Engineering+3TechnologySalary not listed
