Quick overview
Job description
The Senior AI Software Engineer is a senior individual contributor responsible for designing, building, and deploying production-grade AI/ML and Generative AI (GenAI) solutions. This role brings proven, hands-on experience with large language models (LLMs), agentic AI systems, and end-to-end MLOps pipelines, along with experience delivering cloud-native AI services, with a focus on Google Cloud Platform (GCP).
The Senior AI Software Engineer will collaborate closely with cross-functional teams to translate business requirements into scalable, high-impact AI solutions, while providing technical guidance and mentorship to other engineers.
Essential Responsibilities:
- Design, build, and deploy AI/ML and GenAI solutions, including agentic and conversational AI capabilities, using agentic AI frameworks and LLMs (e.g., Vertex AI Agent Builder / ADK, Gemini)
- Develop LLM-based capabilities, including embeddings, Retrieval-Augmented Generation (RAG) pipelines, and vector database integration.
- Build and maintain MLOps and CI/CD pipelines for model training, validation, and deployment.
- Deploy and operate scalable, cloud-native AI services on GCP and Kubernetes using Docker and Infrastructure as Code (Terraform).
- Develop data pipelines and APIs that integrate AI/ML models into enterprise applications.
- Support monitoring, model performance evaluation, and incident response for AI services in production.
- Collaborate with cross-functional teams and contribute to technical design reviews; provide guidance and mentorship to other engineers.
- Recognize opportunities for continuous improvement, including evaluating emerging AI tools and technologies.
- Additional duties as assigned.
Skills and/or Certifications Needed:
-
Bachelor’s degree in Computer Science, Engineering, or related field
-
8+ years of software engineering experience, with at least 3 years of proven experience building and deploying AI/ML solutions in production.
-
Proven hands-on experience with:
-
Agentic AI frameworks (Vertex AI Agent Builder / ADK)
-
Large Language Models (Gemini)
-
Python application development and APIs (FastAPI)
-
Cloud-native architectures on Google Cloud Platform
-
Event-driven workflows and orchestration
-
Enterprise collaboration integrations (Microsoft Teams, Graph API)
-
Experience with GenAI frameworks such as LangChain and Hugging Face.
-
Proven experience developing LLM-based applications, including RAG pipelines and vector databases.
-
Experience building end-to-end MLOps pipelines using tools such as Vertex AI Pipelines, MLflow, or Kubeflow.
-
Proven experience deploying scalable AI/ML services using Docker, Kubernetes, and Terraform.
-
Experience building data pipelines that support AI/ML services.
-
Strong software engineering fundamentals, including testing, code reviews, and version control in an agile environment.
-
Experience with AWS AI/ML services is a plus.
-
Experience with multimodal AI solutions (text, image, audio) is preferred.
-
Strong communication skills, with the ability to explain technical concepts to diverse technical and non-technical stakeholders.
-
Show an ownership mindset in everything you do; be a problem solver, be curious and be inspired to take action, be proactive, seek ways to collaborate and connect with people and teams in support of driving success.
-
Continuous growth mindset, keep learning through social experiences and relationships with stakeholders, experts, colleagues and mentors as well as widen and broaden your competencies through structural courses and programs.
-
Where applicable, fluency in English and languages relevant to the working market.
-
Proficiency in Microsoft Office Suite skills.
- Generous paid time off in your first year, increasing with tenure.
- Up to 16 weeks 100% paid parental leave after one year of employment.
- Paid sick time to care for yourself or family members.
- Education assistance and extensive training resources.
- Do Good Program: Paid volunteer days & donation matching.
- Competitive 401k with company matching.
- Health & wellness benefits, including discounted Wellhub membership rates.
- Medical, dental & vision insurance for you, spouse/partner & dependents.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
