Quick overview
Job description
About Raindrop
Raindrop is the monitoring platform for AI agents. Engineering teams at Fortune 100s and the fastest-growing AI companies (Vercel, Speak, Clay) use it to catch silent failures in production. When an agent misbehaves, Raindrop alerts the team, links to the trace, and surfaces the root cause so they can fix it fast. With Raindrop 2.0 (Self-Healing Agents), the loop closes itself: your coding agent fixes it, and the fix becomes an eval to prevent regressions.
Why It Matters
AI agents fail constantly in ways both hilarious and terrifying. Regular software throws exceptions. But AI agents fail silently, leaving engineers with almost no visibility into how their agents are actually performing.
The current status quo is sifting through millions of logs and trying to debug flaky evals that just aren't matching real world results. Evals are like unit tests, they confirm your model got specific test cases right. But in the real world agents call thousands of tools, run for hours, and encounter millions of unpredictable actions.
That’s where Raindrop comes in. It learns the unique shape of each AI agent’s issues. Starting from presets like Laziness, Forgetting, or Task Failure, to automatically tuning itself to each agent and discovering unknown unknowns.
With one click of a button, AI engineers start tracking issues or topics across 100% of their production data. They can see frequency over time, how many users are affected, relevant properties and more.
In order to process hundreds of millions of events, we gradually train small, custom models, private to each company, that learn to uniquely understand how their product is used.
As part of the early team, you’ll play a fundamental role in shaping the company - from making strategy and product decisions, to helping scale the team, to shaping the future of AI agents.
Our Investors
We've raised $50M total, led by CRV, with backing from Lightspeed, Figma Ventures, Vercel Ventures, and the founders of Replit (Amjad Masad, Michele Catasta), Cognition (Walden Yan), Framer (Koen Bok, Jorn van Dijk), Speak (Andrew Hsu), and Notion (Akshay Kothari).
Your Focus
Own the core product: Create a cohesive experience for both AI engineers and agents to find, triage, and fix issues
Simulations: Build novel tools that help prevent agent failures in the first place
Improve anomaly detection systems: Improve production monitoring systems that find agent failures in real-time
Your Responsibilties
Take ambiguous problems from start to finish. You make product decisions without waiting to be told.
Own the whole system, from the interface to the data underneath. Ship what customers need.
Form a point of view, get the team behind it, and change course when you're wrong.
Work directly with customers to understand how they debug their agents and what they need.
Explain your thinking clearly, in writing and out loud, and say so when you're unsure.
Ideal Candiate
You make problems disappear. Hand you something ambiguous and you come back with it solved.
Conviction: you have opinions, you can make the case to build them and rally the team around you.
Strong product sense: you can work out the actual problem at hand, then solve it.
You've thought about this problem before, and maybe tried building observability or eval tools yourself.
You follow how LLMs and agents are evolving. You use and build AI agents and tools
Must be in person in San Francisco (or willing to move)
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- CO

Research EngineerRecently posted Auto Apply
Continualresearch · New York City · On-site · Posted 16 Nov 2026 🇺🇸
NumPySciPyPandas+3Engineering$150k - $250k/yr - SI

Principal MEMS Development Engineer | 1480Recently posted Auto Apply
SiTime Corporation · California · Hybrid · Posted 13 Nov 2026 🇺🇸
MATLABANSYSContinuous Improvement+3Engineering$148.3k - $203.9k/yr - SI

Sr. MEMS Development Engineer I 1483Recently posted Auto Apply
SiTime Corporation · Michigan · Hybrid · Posted 12 Nov 2026 🇺🇸
MATLABANSYSYouTubeEngineering$99.9k - $137.4k/yr - EU
Senior Laboratory Automation EngineerRecently posted Auto Apply
Eurofins · Indianapolis, IN · On-site · Posted 16 Nov 2026 🇺🇸
RoboticsComplianceContinuous ImprovementTechnologySalary not listed - EU
Lab Operations EngineerRecently posted Auto Apply
Eurofins · Spring House, PA · On-site · Posted 16 Nov 2026 🇺🇸
SpringComplianceContinuous Improvement+2TechnologySalary not listed - BC
Product Engineer I - Project Support (Medical Device)Recently posted Auto Apply
BioPharma Consulting JAD Group · Houston, Texas · On-site · Posted 16 Nov 2026 🇺🇸
HealthcareSalary not listed - AA
Research Engineer, Post-TrainingRecently posted Auto Apply
Actively AI · San Francisco · Hybrid · Posted 16 Nov 2026 🇺🇸
ProspectingTriageEngineeringSalary not listed - AB

Director, Biologics Analytical Development R&DRecently posted Auto Apply
AbbVie · North Chicago, IL · On-site · Posted 16 Nov 2026 🇺🇸
ComplianceSuccession PlanningInstagram+1$160.5k - $305k/yr - AU

Sr. Optical Engineer, R&DRecently posted Auto Apply
Aureliussystems · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
Mechanical DesignTolerance AnalysisEngineeringSalary not listed - VE

Clinical Product Engineer Auto Apply
Verahealth · San Francisco · On-site 🇺🇸
Salary not listed - TI

Senior Research Engineer, Robotics Auto Apply
Tutor Intelligence · Watertown · Hybrid · Posted 7 Nov 2026 🇺🇸
RoboticsC++Lever+4EngineeringSalary not listed - TI

Senior Research Engineer, Infrastructure Auto Apply
Tutor Intelligence · Watertown · Hybrid · Posted 7 Nov 2026 🇺🇸
RustEdge ComputingRobotics+4Salary not listed