Haystack
← Back to Jobs
Other
TI

Head of AI

Triune Infomatics IncSan Jose, CA🇺🇸United StatesPosted 12 Aug 2026

Why This Role Stands Out

This hybrid leadership role at Triune Infomatics Inc. offers an exceptional opportunity to drive innovation in AI engineering and product development, focusing on cutting-edge LLM systems and agentic AI. You'll thrive here if you possess deep expertise in applied AI and a proven track record in leading engineering teams, allowing you to shape the future of AI platforms and deliver impactful solutions. Embrace this chance to make a significant contribution and advance your career in a dynamic environment.

Quick Overview

Seniority
Leader
Work mode
Hybrid
Location
San Jose, CA, United States
Posted
3 weeks ago
AWSGoogle CloudKafkaKubernetesLLMPyTorch

Job Description

Role: Senior Manager, AI Engineering & Product
Location: San Jose, CA (Hybrid)
Duration: 3+ months


Overview:

  • Senior hybrid IC and people leadership role bridging AI systems architecture, agentic AI, and cross-functional product execution
  • Operating level: IC10 / L7 or equivalent (Client, Google, Amazon, or high-growth AI startup calibre)
  • Expected to own roadmap, stakeholder alignment, and end-to-end delivery independently


Must Have: Applied AI, LLM Systems & Inference Optimization, AI Agents & Agentic Frameworks, Distributed AI Infrastructure, AI Platform Architecture, Engineering & People Leadership

Key Responsibilities:

  • Build and scale AI deployment platforms focused on inference speed, latency reduction, and model acceleration
  • Architect Client software libraries and tooling to push LLM inference and training optimization
  • Design and lead multi-agent engineering systems including orchestration, parallelism, and tool usage
  • Prototype and incubate R&D innovations with potential patent value
  • Drive cross-functional alignment and secure R&D budget from senior leadership
  • Lead engineering teams with full autonomy across roadmap, staffing, and delivery


Required Qualifications:

  • 15+ years in engineering, with 8 to 9 years in applied AI
  • Group Manager or Director level experience at a large tech company or high-growth AI startup
  • Deep hands-on expertise in LLM systems: transformers, inference optimization, quantization, KV cache, distributed training (PyTorch FSDP, PEFT/LoRA)
  • Production-grade experience with AI Agents and agentic frameworks (Claude Code, Agent SDK, or equivalent)
  • Infrastructure at scale: Kubernetes, Kafka, Spark, multi-tenant SaaS, AWS, Google Cloud Platform
  • Proven record of building AI platforms from zero to enterprise production (F500 clients preferred)
  • Experience with vector databases, synthetic data pipelines, RAG, Chain of Thought


Nice to Have:

  • Published author or recognized thought leader in AI/ML
  • Startup founding or enterprise incubation experience
  • GPU hardware ecosystem familiarity: CXL, NVMe, PCIe-level AI optimization
  • Stanford GSB or equivalent advanced education

Similar jobs