Back to Jobs
Recently postedRemoteTechnology

Principal AI Architect

InfoVision, Inc.United States🇺🇸United States

Quick overview

SeniorityLeader
Work modeRemote
LocationUnited States
AWSMLOpsBigQueryComputer VisionGoogle CloudLLMPyTorchPythonTensorFlowTerraformAzureMachine LearningLangChainRAGNetwork Administration

Job description

Principal AI Architect

Remote role

Role Summary:

This role combines hands-on forward deployment with ownership of AI architecture. You will define the reference architecture for Client’s AI Center of Excellence (CoE), built around an AI plane on Google Cloud, and work directly with business and engineering teams to put AI systems into production with measurable business impact.

Key Responsibilities:

Architecture and strategy

  • Define and maintain the enterprise AI reference architecture and AI plane, covering model access, retrieval, agent orchestration, evaluation, guardrails, observability, and governance.
  • Develop and execute an AI CoE roadmap aligned with business objectives, supported by architecture decision records, reusable patterns, and reference implementations.

Delivery

  • Embed with business and engineering teams to scope, prototype, and deploy LLM and agentic solutions into production.
  • Lead the end-to-end lifecycle of AI projects: data engineering, model or prompt development, testing, and deployment on Google Cloud Platform.
  • Design AI solutions for predictive analytics, intelligent automation, and real-time decision systems (e.g., BigQuery, Pub/Sub, Dataflow).

Infrastructure and MLOps

  • Build and optimize infrastructure for LLM serving, fine-tuning, and distributed training on GPUs and TPUs.
  • Implement MLOps for model deployment, monitoring, and lifecycle management.

Responsible AI and governance

  • Establish evaluation harnesses, guardrails, and responsible AI controls covering bias, fairness, security, and regulatory compliance.
  • Partner with security, legal, and compliance teams on AI risk assessment, data residency, and governance.
  • Enablement
  • Enable internal teams through standards, templates, runbooks, and training so they can operate and extend AI solutions independently.
  • Mentor engineers and foster collaboration between AI teams and cross-functional departments.

Required Qualifications:

  • 8+ years in software engineering, solution architecture, or AI/ML delivery, including 3+ years deploying LLM or AI systems to production.
  • Hands-on experience with Google Cloud Platform (Vertex AI, GKE or Cloud Run, BigQuery); working familiarity with AWS or Azure.
  • Deep knowledge of transformer-based models, LLMs, retrieval-augmented generation, and multimodal AI, with hands-on use of PyTorch, TensorFlow, or JAX.
  • Experience with MLOps and with GPU/TPU-based training or serving infrastructure.
  • Proven track record of designing AI reference architectures or platforms and deploying AI systems with measurable business impact.
  • Ability to present architecture artifacts to executive audiences.
  • Strong Python skills and experience integrating enterprise APIs and data sources.

Preferred Qualifications:

  • Google Cloud Professional Cloud Architect or Professional Machine Learning Engineer certification.
  • Experience establishing an AI CoE, AI governance model, or AI operating model.
  • Computer vision experience.
  • Familiarity with NIST AI RMF, ISO/IEC 42001, and the EU AI Act.
  • Telecom or network infrastructure background.

Tech Stack (representative):

  • Python, Google Cloud Platform, Vertex AI, BigQuery, GKE, Cloud Run, Pub/Sub, Dataflow, PyTorch, RAG frameworks (e.g., LangChain, LlamaIndex), MCP, Terraform

Will your resume get past this employer's screening? Check your resume against this job, free

Similar jobs