Haystack
← Back to Jobs
Technology

Senior AI Architect & Lead Prompt Engineer

AIT Global, Inc.Sunnyvale, CA🇺🇸United StatesPosted 22 Jul 2026

Why This Role Stands Out

This hybrid role offers a remarkable opportunity to shape the future of AI by leading advanced prompt engineering and multi-agent system architecture on Google Cloud. You will thrive here if you have deep expertise in LLM stacks, enterprise integrations, and agentic systems, allowing you to innovate and grow within a dynamic technology environment.

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Job Title: Senior AI Architect & Lead Prompt Engineer
Location: Sunnyvale, CA
Key Responsibilities:
  • AI Architecture & Design: Lead the end-to-end architecture of multi-agent
  • systems, moving from initial concept to production-grade deployment on Google
  • Cloud Platform (Google Cloud Platform).
  • Prompt Engineering & Orchestration: Develop sophisticated prompt
  • engineering frameworks, including system prompts, few-shot templates, and
  • output guardrails. Utilize Chain-of-Thought (CoT) prompting and structured
  • prompt chains for complex reasoning tasks.
  • Intelligent Dialog Systems: Design conversational interfaces using Dialogflow
  • and Gemini-powered agents to manage inquiry routing and automated workflow
  • orchestration.
  • System Integration: Architect integrations between LLM platforms (Vertex
  • AI/Gemini) and enterprise CRM/ITSM tools like Salesforce and ServiceNow,
  • specifically focusing on Telecom-grade inquiry response and ticketing workflows.
  • RAG & Knowledge Retrieval: Build and optimize RAG (Retrieval-Augmented
  • Generation) pipelines grounded in internal client policies and technical
  • documentation.
  • MLOps & Deployment: Oversee the deployment of microservices using GKE
  • (Google Kubernetes Engine), Cloud SQL, and Cloud Build, ensuring scalable
  • and reliable AI performance.
Required Core Expertise:
  • LLM Stack: Deep expertise in Gemini, Vertex AI, and LangChain or
  • LlamaIndex.
  • Enterprise Integration: Proven experience architecting AI solutions that
  • interface with Salesforce and ServiceNow within a Telecom or large enterprise
  • context.
  • Agentic Systems: Experience building multi-agent architectures for autonomous
  • task execution and workflow automation.
  • Data & Search: Mastery of hybrid search, reranking, and vector databases (e.g.,
  • Redis, PostgreSQL).
Qualifications:
  • Experience: 10+ years in the AI stack, ranging from classical NLP/NLU to
  • modern generative AI architectures.
  • Education: B.Tech in Computer Science, Mathematics, or a related technical
  • field.
  • Technical Proficiency: Strong command of Python, Terraform IAC, Docker, and
  • the Google Cloud Platform ecosystem (GKE, Cloud Deploy).
  • Industry Knowledge: Demonstrated understanding of the Service Now,
  • Salesforce, Net Cracker in Telecommunications service lifecycle, specifically
  • regarding inquiry management and automated support.
Tools & Platforms:
  • AI/ML: Gemini, Vertex AI, Hugging Face, OpenAI, Claude.
  • Frameworks: LangChain, LlamaIndex, Dialogflow.
  • Cloud & Infra: Google Cloud Platform (GKE, Cloud Build), Docker, TensorRT.
  • Data: Cloud SQL, PostgreSQL, Redis.

Skills

Docker
Microservices
SQL
MLOps
NLP
Generative AI
Google Cloud
Hugging Face
Kubernetes
LLM
PostgreSQL
Python
Redis
Terraform

Similar jobs

Browse related jobs

Apply now