Haystack
← Back to Jobs
Other
AT

Looking for Agentic AI-Sr Architect - Santa Clara, CA - Full-time

Aroha TechnologiesSanta Clara, CA🇺🇸United StatesPosted 18 Aug 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Role: Agentic AI-Sr Architect
Location: Santa Clara, CA
Duration: Full-time

Role Overview

  • We are seeking an experienced Agentic AI Senior Architect to design, develop, and deploy production-grade AI/LLM solutions. The ideal candidate will have strong hands-on experience with LLMs, Agentic AI, speech/voice AI, cloud AI platforms, and Azure services, along with the ability to lead technical teams and drive AI architecture.

Required Qualifications

  • Bachelor's/Master's degree in Computer Science, AI/ML, Data Science, or related field.
  • 6 10 years of AI/ML/Deep Learning experience.
  • 2 3 years of hands-on experience with LLMs, NLP, Speech/Voice AI, or real-time voice pipelines.
  • 3 5 years deploying AI solutions in production.
  • 5+ years with Python, PyTorch, TensorFlow, or similar frameworks.
  • 3 5 years designing, training, and fine-tuning AI/LLM or speech/voice models.
  • 5 years of experience with AWS SageMaker, Azure ML, or Google Cloud Platform AI.
  • 2+ years with Agentic AI frameworks such as LangChain, LangGraph, MCP, A2A, and multi-agent orchestration.
  • Experience with model evaluation, optimization, bias detection, and performance tuning.
  • Strong experience integrating AI models into applications through APIs and pipelines.
  • 2 3 years of experience with Azure AI services, including Azure OpenAI, Azure AI Speech, Translator, AI Search, AKS/Container Apps, API Management, Event Hubs, Key Vault, and Application Insights.

Key Responsibilities

  • Design, develop, and deploy scalable AI/LLM and Agentic AI solutions.
  • Build and optimize multi-agent and real-time voice AI pipelines.
  • Evaluate, fine-tune, and improve model performance, reliability, and scalability.
  • Collaborate with Data Engineering, Software Engineering, and LLMOps teams.
  • Troubleshoot AI deployment and integration challenges.
  • Research emerging AI technologies and recommend innovative solutions.
  • Mentor junior AI engineers and review code, models, and architectures.
  • Communicate AI concepts and technical findings to technical and non-technical stakeholders.
  • Work in Agile/Scrum environments using tools such as Jira or Azure DevOps.

Preferred / Future Skills

  • Advanced LLM techniques, prompt engineering, and fine-tuning.
  • Responsible AI, ethics, fairness, and bias mitigation.
  • LLMOps, including model evaluation, tracing, CI regression testing, cost telemetry, model routing, and drift detection.
  • Evaluation metrics such as WER, Entity F1, and COMET.

Skills

AWS
NLP
Scrum
Agile
Azure
Deep Learning
Google Cloud
Jira
LLM
PyTorch
Python
TensorFlow
Vault

Similar jobs