Quick Overview
Job Description
About the Role
Build developer tools that help AI agent teams evaluate and improve agents using execution traces. This product engineering role combines hands-on development with community engagement, so insights from builders can directly shape what gets shipped.
What You'll Do
Build and ship features for agent evaluations, replay, cohorts, and developer experience.
Share technical work through posts, demos, and conversations on public developer channels, and bring useful feedback into product decisions.
Work across feature development, customer demos, marketing activities, and community engagement as priorities require.
Stay connected to AI agent builders and evaluation practitioners, including those using agent frameworks and custom runtimes.
Connect community feedback with product development, and communicate shipped improvements to the developer community.
What We're Looking For
At least 3 years of experience building or shipping production software, including production experience building or evaluating AI agents.
Production proficiency in Python and hands-on experience with agent frameworks such as LangGraph, Claude Code, or equivalent tools.
Experience with LLM or agent evaluation systems, trace data, observability, or debugging agent execution.
Open-source contributions or developer tools with demonstrated use by other developers.
Experience shipping SDKs, APIs, CLI tools, frameworks, or libraries, with attention to documentation, ergonomics, and demos.
Experience supporting distribution or go-to-market for products you helped engineer, and communicating technical work publicly.
Comfort working across responsibilities in an early-stage or otherwise high-uncertainty environment.
Compensation & Benefits
Base salary: $110,000 to $190,000 USD annually. Visa sponsorship is available.
Location
Remote, with the primary location in Munich, Bavaria, Germany.
Similar jobs
- GL
Senior Software Engineer, Security Assurance | Germany | Remote
NewAuto ApplyGrafana Labs
Germany (Remote)🇩🇪Remote12 hours agoPCI DSSSOC 2Salesforce+8Technology - CL
Langfuse - Senior Software Engineer, SDK
NewAuto ApplyClickhouse
Germany🇩🇪Hybrid13 hours agoJavaLLMPython+2Technology - CL
Senior Product Engineer
NewAuto ApplyClera
Munich🇩🇪On-site13 hours agoOnboardingPythonReact - CL
Senior Robotic Systems Engineer
NewAuto ApplyClera
Munich🇩🇪On-site13 hours agoRoboticsCADCATIA+4Technology - TO
Senior Software Engineer
NewAuto ApplyTOPdesk
Kaiserslautern, RP🇩🇪€5.8k - €6.5k/moHybrid15 hours agoTypeScriptJavaSQL+4Technology - FE
Senior Software Engineer
NewAuto ApplyFender
Hamburg🇩🇪Hybrid20 hours agoConfluenceContinuous ImprovementC+++3Technology - AN
Staff Engineer
NewAuto ApplyAndercore
Berlin🇩🇪Hybrid22 hours agoNext.jsNode.jsSpring+12Technology - SI
Limited employment up to 6 months (f/m/d) - Software Developer – Cloud ALM & Access Management
NewAuto ApplySAP IT Business Systeme
St.Leon-Rot🇩🇪Hybrid20 hours agoScrumJavaJavaScriptTechnology - SI
Working Student (f/m/d) – Software Engineering for ABAP Cloud Tooling
NewAuto ApplySAP IT Business Systeme
Walldorf🇩🇪Hybrid18 hours agoJavaGitTechnology - BA
Softwareentwickler*in Customer Data Store
NewAuto ApplyBarmeniaGothaer AG
Köln, NRW🇩🇪Hybrid18 hours agoMongoDBSpringSpring Boot+4Technology - BG
Praktikum Softwareentwicklung für Bosch eBike Systems ABS
NewAuto ApplyBosch Group
Reutlingen, BW🇩🇪Hybrid18 hours agoC++JenkinsGitTechnology - CL
Software Engineer, Foundation (Mid-Level)
NewAuto ApplyClera
Berlin🇩🇪On-siteYesterdayFlutterDartTechnology