Quick overview
Job description
As a Senior AI Engineer, you will be at the forefront of our Generative AI initiatives. We treat AI as a software engineering discipline. You will be responsible for the full lifecycle of our AI features—specifically document intelligence and RAG pipelines—taking them from initial prototype to robust, scalable production services. You will solve for real-world constraints like latency, error handling, and cost optimization.
You’ll collaborate with a diverse range of clients to translate business needs into high-performance AI architectures. This role requires a blend of deep technical expertise in LLMs and a disciplined Software Engineering approach to ensure our solutions are robust, ethical, and scalable.
What You Will Do:
- Architect & Build: Design and implement end-to-end GenAI applications using Python, LangChain, and LlamaIndex on Google Cloud
-
Engineer for Precision: Develop advanced RAG (Retrieval-Augmented Generation) pipelines and Semantic Search systems using Google Cloud Vector Search or Pinecone
-
Optimize Models: Lead efforts in LLM and Embedding fine-tuning to improve domain-specific performance
-
Agentic Ops: Build and manage agentic workflows that automate complex multi-step reasoning tasks
-
Collaborate & Innovate: Work directly with customers to understand requirements, suggest novel features, and implement state-of-the-art AI techniques
-
Productionize: Apply MLOps best practices to ensure models are served efficiently, monitored, and continuously improved
Your Technical Toolkit:
- Core Languages: Mastery of Python and shell scripting
-
AI/LLM Ecosystem: Extensive experience with Google Gemini, GPT-4, or LLaMA; deep knowledge of Prompt Engineering and Fine-tuning
-
Data & Search: Expertise in Vector Databases (Vertex AI Vector Search, pgvector, etc.) and implementing Semantic Search
-
Infrastructure: Hands-on experience with Google Cloud (Vertex AI) and building scalable software architectures
-
Frameworks: Proficiency in LangChain, LlamaIndex, or similar orchestration layers
-
Mindset: A strong software engineering foundation—you write clean, maintainable code and understand the full SDLC
Basic Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field
-
5+ years of experience in AI/ML
-
Proven track record of deploying GenAI products to a production environment
-
Experience with Classic Machine Learning (neural nets, training, tuning) is a strong plus
-
Knowledge of Data Engineering and SQL
Personal Attributes:
- Ownership: You take pride in your code and see projects through from concept to deployment
-
Curiosity: The AI landscape changes weekly; you are a lifelong learner who stays ahead of the curve
Consultative Spirit: You enjoy interacting with clients and can translate technical complexity into business value
Ethics: You prioritize responsible AI development and data privacy
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- MI

Software Engineer, AI Developer PlatformRecently posted Auto Apply
Mirage · Union Square · Hybrid · Posted 14 Nov 2026 🇺🇸
LLMPenetration TestingTriage+1TechnologySalary not listed - TT
Lead AI EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 15 Nov 2026 🇺🇸
DockerGCPSQL+11Technology$175k - $300k/yr - TT
ML / AI EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
FastAPINLPPython+3Technology$200k - $300k/yr - TI

Applied AI Engineer, Finance Auto Apply
Tutor Intelligence · Watertown · Hybrid · Posted 5 Nov 2026 🇺🇸
SQLLinearRobotics+4TechnologySalary not listed - TI

Applied AI Engineer, Go-to-Market Auto Apply
Tutor Intelligence · Watertown · Hybrid · Posted 5 Nov 2026 🇺🇸
SQLLinearRobotics+6TechnologySalary not listed - SA

AI Engineer Intern - Fury Team (Summer 2027) Auto Apply
Scout Ai · Sunnyvale · On-site · Posted 23 Oct 2026 🇺🇸
RoboticsDeep LearningPyTorch+3TechnologySalary not listed - SA

Senior AI Engineer Auto Apply
Scout Ai · Sunnyvale · Remote 🇺🇸
RoboticsDeep LearningPyTorch+2TechnologySalary not listed - RE

AI Engineer (LLM systems) Auto Apply
Refine · United States · Remote · Posted 27 Oct 2026 🇺🇸
SOC 2GPTLitigation+1TechnologySalary not listed - PL
Member of Technical Staff, Head of AI Quality Auto Apply
Plato.so · San Francisco · On-site 🇺🇸
AuditingConcreteLLM+1Salary not listed - F7
Staff Engineer, Hivemind Reasoning (R6292) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · San Mateo · Hybrid · Posted 19 Oct 2026 🇺🇸
Talent AcquisitionMLOpsRobotics+5TechnologySalary not listed - SE
Staff AI Engineer, Agentic AI Harness & Quality - MoveworksRecently posted Auto Apply
ServiceNow · Mountain View, CALIFORNIA · On-site · Posted 13 Nov 2026 🇺🇸
PythonGoMachine Learning+1Technology$176.1k - $308.2k/yr - CR
Associate Director - AI TransformationRecently posted Auto Apply
Continuum Resource Network · Atlanta, Georgia · Hybrid · Posted 15 Nov 2026 🇺🇸
Generative AIRAGSalary not listed
