Haystack
← Back to Jobs
Technology
TL

Senior Software Development Engineer – Generative AI & LLM Platforms

Technical LinkVancouver, BC🇺🇸United StatesPosted 25 Aug 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Vancouver, BC, United States
Posted
Yesterday
AWSMachine Learning.NETGenerative AIJavaJavaScriptLLMPython

Job Description

Senior Software Development Engineer – Generative AI / LLM

Job Summary

The AI Research & Development organization is seeking a Senior Software Development Engineer to help build and scale the next generation of Generative AI and Large Language Model (LLM) technologies. This role will focus on developing production-grade software systems that support frontier AI initiatives, model deployment, model steering frameworks, and scalable AI infrastructure.

The successful candidate will partner closely with AI researchers, applied scientists, machine learning engineers, and product teams to transform advanced research into highly available, customer-facing solutions. Candidates should possess strong software engineering fundamentals, experience building distributed systems at scale, and the ability to rapidly contribute in both Java and Python environments.

Key Responsibilities

  • Design, develop, test, deploy, and maintain scalable software systems supporting AI and LLM initiatives.

  • Collaborate with AI R&D teams to operationalize frontier model research and machine learning innovations.

  • Build and enhance LLM development platforms, evaluation frameworks, and model steering capabilities.

  • Lead architecture and design efforts for highly available, reliable, and scalable distributed systems.

  • Drive engineering excellence through code reviews, design reviews, operational best practices, and mentoring.

  • Partner with cross-functional stakeholders to define technical strategy and long-term architectural direction.

  • Improve system performance, reliability, security, and operational efficiency across AI platforms.

  • Mentor engineers and provide technical leadership across multiple projects and teams.

Basic Qualifications

  • 5+ years of non-internship professional software development experience.

  • 5+ years of programming experience with at least one modern software programming language.

  • 5+ years of experience leading the design or architecture of new and existing systems, including design patterns, reliability, scalability, and performance considerations.

  • Experience serving as a mentor, technical lead, or engineering team leader.

  • Strong understanding of AI/ML principles and modern software engineering practices.

  • Experience developing or supporting Large Language Models (LLMs), Generative AI applications, or machine learning platforms.

  • Ability to switch between Java and Python development environments with minimal ramp-up time.

Preferred Qualifications

  • 7+ years of experience across the full software development lifecycle, including coding standards, code reviews, source control management, build processes, testing, deployment, and operations.

  • Bachelor''s degree in Computer Science, Computer Engineering, Software Engineering, or equivalent practical experience.

  • Experience with programming languages such as Python, JavaScript, Go, .NET, Java, or equivalent.

  • Experience developing distributed systems, cloud-native applications, or large-scale data processing platforms.

  • Familiarity with frontier LLM development, model evaluation, alignment, safety, or steering frameworks.

  • Experience working within AI research, machine learning infrastructure, or advanced technology organizations.

  • Experience with AWS services and cloud-based architectures.

Technical Skills

  • Large Language Models (LLMs)

  • Generative AI

  • AI/ML Platform Development

  • Frontier Model Development

  • Model Steering & Alignment Frameworks

  • Python

  • Java

  • Distributed Systems Architecture

  • Cloud Computing (AWS)

  • Software Design Patterns

  • Reliability Engineering

  • Scalability & Performance Optimization

  • DevOps & CI/CD Practices

Similar jobs