Haystack
← Back to Jobs
Engineering

Prompt Engineer Lead / Architect

Kutir IncSunnyvale, CA🇺🇸United StatesPosted 29 Jul 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Position Title: Prompt Engineer Lead / Architect

Location: Sunnyvale CA

Duration: 6+ months

Key Responsibilities:

AI Architecture & Design: Lead the end-to-end architecture of multi-agent systems, moving from initial concept to production-grade deployment on Google Cloud Platform (Google Cloud Platform).

Prompt Engineering & Orchestration: Develop sophisticated prompt engineering frameworks, including system prompts, few-shot templates, and output guardrails. Utilize Chain-of-Thought (CoT) prompting and structured prompt chains for complex reasoning tasks.

Intelligent Dialog Systems: Design conversational interfaces using Dialogflow and Gemini-powered agents to manage inquiry routing and automated workflow orchestration.

System Integration: Architect integrations between LLM platforms (Vertex AI/Gemini) and enterprise CRM/ITSM tools like Salesforce and ServiceNow, specifically focusing on Telecom-grade inquiry response and ticketing workflows.

RAG & Knowledge Retrieval: Build and optimize RAG (Retrieval-Augmented Generation) pipelines grounded in internal client policies and technical documentation.

MLOps & Deployment: Oversee the deployment of microservices using GKE (Google Kubernetes Engine), Cloud SQL, and Cloud Build, ensuring scalable and reliable AI performance.

Required Core Expertise:

LLM Stack: Deep expertise in Gemini, Vertex AI, and LangChain or LlamaIndex.

Enterprise Integration: Proven experience architecting AI solutions that interface with Salesforce and ServiceNow within a Telecom or large enterprise

context.

Agentic Systems: Experience building multi-agent architectures for autonomous task execution and workflow automation.

Data & Search: Mastery of hybrid search, reranking, and vector databases (e.g., Redis, PostgreSQL).

Qualifications:

Experience: 10+ years in the AI stack, ranging from classical NLP/NLU to modern generative AI architectures.

Education:

B.Tech in Computer Science, Mathematics, or a related technical field.

Technical Proficiency:

Strong command of Python, Terraform IAC, Docker, and the Google Cloud Platform ecosystem (GKE, Cloud Deploy).

Industry Knowledge: Demonstrated understanding of the Service Now, Salesforce, Net Cracker in Telecommunications service lifecycle, specifically regarding inquiry management and automated support.

Tools & Platforms:

AI/ML: Gemini, Vertex AI, Hugging Face, OpenAI, Claude.

Frameworks: LangChain, LlamaIndex, Dialogflow.

Cloud & Infra: Google Cloud Platform (GKE, Cloud Build), Docker, TensorRT.

Data: Cloud SQL, PostgreSQL, Redis

Similar jobs