Quick overview
Job description
About Boson AI: At Boson AI, we are not just building AI solutions; we are pioneering the future of enterprise AI. Driven by a passion for cutting-edge AI research, particularly in the transformative areas of large language models and agentic systems, our mission is to tackle the most complex real-world problems for businesses and unlock significant value. We are a dynamic and collaborative team of researchers and engineers who thrive on pushing the boundaries of what's possible, dedicated to delivering high-quality, reliable products that seamlessly integrate into the fabric of enterprise workflows and set new industry standards.
About the Role: Help build and operate the core platform behind Boson's model APIs and agentic products. You'll work alongside senior engineers on the infrastructure that every Boson agent runs on — API serving, state management, data pipelines, context retrieval, and execution runtime — shipping real features while growing into deeper ownership over time. This is a role for someone early in their career who wants to learn distributed systems by building them, with strong mentorship and meaningful production responsibility from day one.
Responsibilities
- Contribute to the core platform infrastructure: the API serving layer, state management, policy enforcement, and execution runtime for agentic workflows — starting with well-scoped components and taking on broader ownership as you grow.
- Help build and maintain distributed services that back our model API products, including request routing, rate limiting, and multi-tenant isolation, under the guidance of senior engineers.
- Build and maintain pieces of our data pipelines (ETL/ELT) for API logs, usage analytics, and billing, with a focus on data correctness and freshness.
- Develop and improve internal SDKs and libraries — writing clean, well-tested code with clear contracts that product teams can rely on.
- Support our context and memory systems for conversational workloads: retrieval, caching, and integration with vector stores and retrieval pipelines.
- Add observability across the platform — structured logging, tracing, and metrics — and help investigate and resolve reliability issues.
- Collaborate with ML and product teams to integrate model serving, voice runtime, and tooling infrastructure, learning how the full stack fits together.
Qualifications
- 0–2 years of professional software engineering experience (internships, co-ops, and strong personal or open-source projects count), or a recent CS degree with equivalent hands-on work.
- Solid programming fundamentals and a genuine interest in backend and distributed systems — you understand concepts like concurrency and fault tolerance and are eager to apply them in production.
- Some exposure to building backend services, APIs, or data processing — through work, coursework, or projects.
- Proficiency in at least one language such as Python, Go, Java, Rust, or C++, and a willingness to pick up new ones.
- Familiarity with the basics of cloud infrastructure (AWS/GCP), containers (Docker/K8s), version control, and CI/CD — or clear enthusiasm to learn them quickly.
- Curiosity, strong communication, and a collaborative mindset — you ask good questions, welcome feedback, and want to grow.
Bonus points
- Coursework, projects, or internship experience touching LLM serving, retrieval, or agentic systems.
- Exposure to data pipeline tools (Kafka/Kinesis, Spark/Flink, Airflow) or agent frameworks.
- Experience with real-time media (audio/video streaming) or any latency-sensitive system.
- A track record of shipping something end-to-end — a side project, a hackathon build, or an open-source contribution you're proud of.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- TT
Product EngineerRecently posted Auto Apply
True Talent Solutions Partners · Palo Alto · On-site · Posted 17 Nov 2026 🇺🇸
SQLAmplitudeMixpanel+4$185k - $205k/yr - TT
Software Engineer, C++ SystemsRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 17 Nov 2026 🇺🇸
RustC++Kubernetes+1Technology$250k - $325k/yr - TT
Senior Forward Deployed Engineer, OperateRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 17 Nov 2026 🇺🇸
GCPNext.jsApache Spark+14Engineering$170k - $205k/yr - TT
Lead Product EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 17 Nov 2026 🇺🇸
SourcingNext.jsFigma+1$225k - $275k/yr - TT
Founding Forward Deployed EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 17 Nov 2026 🇺🇸
OnboardingSQLPython+1Engineering$180k - $250k/yr - TG
Senior Software Engineer - Austin, TXRecently posted Auto Apply
TeamViewer Germany GmbH · Austin · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionOnboardingDocker+12TechnologySalary not listed - HA

Forward Deployed EngineerRecently posted Auto Apply
Hume Ai · Hume AI HQ · On-site · Posted 17 Nov 2026 🇺🇸
PythonTypeScriptEngineeringSalary not listed - RA
Software and Controls Team LeadRecently posted Auto Apply
Rai · Cambridge · On-site · Posted 17 Nov 2026 🇺🇸
GitRoboticsC+++3Technology$200.2k - $371.8k/yr - RA
Sr. Simulation EngineerRecently posted Auto Apply
Rai · Cambridge · On-site · Posted 17 Nov 2026 🇺🇸
DockerGitRobotics+6Engineering$175.6k - $371.8k/yr - RA
Sr. Build EngineerRecently posted Auto Apply
Rai · Cambridge · On-site · Posted 17 Nov 2026 🇺🇸
GitEmbedded SystemsRobotics+6Engineering$175.6k - $371.8k/yr - RA
Robotics Software Engineer Interactive MobilityRecently posted Auto Apply
Rai · Cambridge · On-site · Posted 17 Nov 2026 🇺🇸
GitRoboticsC+++4Technology$140.9k - $261.3k/yr - RA
Senior Software Engineer Interactive MobilityRecently posted Auto Apply
Rai · Cambridge · On-site · Posted 17 Nov 2026 🇺🇸
DockerGitRobotics+8Technology$178.5k - $326.0k/yr