Quick overview
Job description
The Senior AI Software Engineer is a senior individual contributor responsible for designing, building, and deploying production-grade AI/ML and Generative AI (GenAI) solutions. This role brings proven, hands-on experience with large language models (LLMs), agentic AI systems, and end-to-end MLOps pipelines, along with experience delivering cloud-native AI services, with a focus on Google Cloud Platform (GCP).
The Senior AI Software Engineer will collaborate closely with cross-functional teams to translate business requirements into scalable, high-impact AI solutions, while providing technical guidance and mentorship to other engineers.
Essential Responsibilities:
- Design, build, and deploy AI/ML and GenAI solutions, including agentic and conversational AI capabilities, using agentic AI frameworks and LLMs (e.g., Vertex AI Agent Builder / ADK, Gemini)
- Develop LLM-based capabilities, including embeddings, Retrieval-Augmented Generation (RAG) pipelines, and vector database integration.
- Build and maintain MLOps and CI/CD pipelines for model training, validation, and deployment.
- Deploy and operate scalable, cloud-native AI services on GCP and Kubernetes using Docker and Infrastructure as Code (Terraform).
- Develop data pipelines and APIs that integrate AI/ML models into enterprise applications.
- Support monitoring, model performance evaluation, and incident response for AI services in production.
- Collaborate with cross-functional teams and contribute to technical design reviews; provide guidance and mentorship to other engineers.
- Recognize opportunities for continuous improvement, including evaluating emerging AI tools and technologies.
- Additional duties as assigned.
Skills and/or Certifications Needed:
-
Bachelor’s degree in Computer Science, Engineering, or related field
-
8+ years of software engineering experience, with at least 3 years of proven experience building and deploying AI/ML solutions in production.
-
Proven hands-on experience with:
-
Agentic AI frameworks (Vertex AI Agent Builder / ADK)
-
Large Language Models (Gemini)
-
Python application development and APIs (FastAPI)
-
Cloud-native architectures on Google Cloud Platform
-
Event-driven workflows and orchestration
-
Enterprise collaboration integrations (Microsoft Teams, Graph API)
-
Experience with GenAI frameworks such as LangChain and Hugging Face.
-
Proven experience developing LLM-based applications, including RAG pipelines and vector databases.
-
Experience building end-to-end MLOps pipelines using tools such as Vertex AI Pipelines, MLflow, or Kubeflow.
-
Proven experience deploying scalable AI/ML services using Docker, Kubernetes, and Terraform.
-
Experience building data pipelines that support AI/ML services.
-
Strong software engineering fundamentals, including testing, code reviews, and version control in an agile environment.
-
Experience with AWS AI/ML services is a plus.
-
Experience with multimodal AI solutions (text, image, audio) is preferred.
-
Strong communication skills, with the ability to explain technical concepts to diverse technical and non-technical stakeholders.
-
Show an ownership mindset in everything you do; be a problem solver, be curious and be inspired to take action, be proactive, seek ways to collaborate and connect with people and teams in support of driving success.
-
Continuous growth mindset, keep learning through social experiences and relationships with stakeholders, experts, colleagues and mentors as well as widen and broaden your competencies through structural courses and programs.
-
Where applicable, fluency in English and languages relevant to the working market.
-
Proficiency in Microsoft Office Suite skills.
- Generous paid time off in your first year, increasing with tenure.
- Up to 16 weeks 100% paid parental leave after one year of employment.
- Paid sick time to care for yourself or family members.
- Education assistance and extensive training resources.
- Do Good Program: Paid volunteer days & donation matching.
- Competitive 401k with company matching.
- Health & wellness benefits, including discounted Wellhub membership rates.
- Medical, dental & vision insurance for you, spouse/partner & dependents.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- AL
DevOps EngineerRecently posted Auto Apply
Allego · Waltham · Hybrid · Posted 20 Nov 2026 🇺🇸
SQLAWSCustomer Success+6Technology$100k - $154k/yr - AL
Business Intelligence Director - AmericasRecently posted Auto Apply
AlixPartners · Boston +4 · Hybrid · Posted 20 Nov 2026 🇺🇸
Market ResearchContinuous ImprovementFinancial Analysis+5Technology$195k/yr - AA
Principal Engineer, Investment SystemsRecently posted Auto Apply
Acadian Asset Management LLC · Boston · Hybrid · Posted 20 Nov 2026 🇺🇸
TechnologySalary not listed - TF
Network Engineer 4 - InfrastructureRecently posted Auto Apply
Tria Federal · Suitland · Hybrid · Posted 20 Nov 2026 🇺🇸
FiberAWSCompliance+3TechnologySalary not listed - SE

Senior Cloud Security Engineer, FedRAMPRecently posted Auto Apply
Sentilink · United States · Remote · Posted 20 Nov 2026 🇺🇸
AWSEncryptionPCI DSS+10Technology$180k - $230k/yr - SE

Senior Software Engineer, Product SecurityRecently posted Auto Apply
Sentilink · United States · Remote · Posted 20 Nov 2026 🇺🇸
FastAPIAWSPCI DSS+13Technology$180k - $230k/yr - SE

Staff Software Engineer, Product SecurityRecently posted Auto Apply
Sentilink · United States · Remote · Posted 20 Nov 2026 🇺🇸
RustAWSPCI DSS+10Technology$210k - $260k/yr - RU

IT LeadRecently posted Auto Apply
Runlayer · Remote (US Timezones) · Remote · Posted 20 Nov 2026 🇺🇸
OnboardingEncryptionSOC 2+11TechnologySalary not listed - SA

Staff SCADA Integration EngineerRecently posted Auto Apply
Saronic · Austin · On-site · Posted 20 Nov 2026 🇺🇸
SQLC#ERP+7TechnologySalary not listed - SA

Staff Data EngineerRecently posted Auto Apply
Saronic · Austin · On-site · Posted 20 Nov 2026 🇺🇸
OnboardingSQLApache Spark+11TechnologySalary not listed - RO

Security EngineerRecently posted Auto Apply
Roadrunner · San Francisco · On-site · Posted 20 Nov 2026 🇺🇸
AWSSnowflakeCompliance+6TechnologySalary not listed - ZI

QA Automation Engineer (SDET) - Dallas, TX Only (Hybrid)Recently posted Auto Apply
Zimperium · Dallas · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerMySQLSQL+19TechnologySalary not listed
