Quick overview
Job description
About Raindrop
Raindrop is the monitoring platform for AI agents. Engineering teams at Fortune 100s and the fastest-growing AI companies (Vercel, Speak, Clay) use it to catch silent failures in production. When an agent misbehaves, Raindrop alerts the team, links to the trace, and surfaces the root cause so they can fix it fast. With Raindrop 2.0 (Self-Healing Agents), the loop closes itself: your coding agent fixes it, and the fix becomes an eval to prevent regressions.
Why It Matters
AI agents fail constantly in ways both hilarious and terrifying. Regular software throws exceptions. But AI agents fail silently, leaving engineers with almost no visibility into how their agents are actually performing.
The current status quo is sifting through millions of logs and trying to debug flaky evals that just aren't matching real world results. Evals are like unit tests, they confirm your model got specific test cases right. But in the real world agents call thousands of tools, run for hours, and encounter millions of unpredictable actions.
That’s where Raindrop comes in. It learns the unique shape of each AI agent’s issues. Starting from presets like Laziness, Forgetting, or Task Failure, to automatically tuning itself to each agent and discovering unknown unknowns.
With one click of a button, AI engineers start tracking issues or topics across 100% of their production data. They can see frequency over time, how many users are affected, relevant properties and more.
In order to process hundreds of millions of events, we gradually train small, custom models, private to each company, that learn to uniquely understand how their product is used.
As part of the early team, you’ll play a fundamental role in shaping the company - from making strategy and product decisions, to helping scale the team, to shaping the future of AI agents.
Our Investors
We've raised $50M total, led by CRV, with backing from Lightspeed, Figma Ventures, Vercel Ventures, and the founders of Replit (Amjad Masad, Michele Catasta), Cognition (Walden Yan), Framer (Koen Bok, Jorn van Dijk), Speak (Andrew Hsu), and Notion (Akshay Kothari).
Your Focus
Build out a world-class product - servicing millions of requests a day + growing.
Architect, implement, and scale the application
Quick iteration without compromising on quality
Deeply understand the customer
Ideal Candiate
Knows how to balance short-term and long-term speed
Proven experience scaling applications
Interest in AI products + tools (ideally experience building these or an avid user)
Willing to do whatever it takes to solve a problem
Cares about building well-designed products
Must be in person in San Francisco (or willing to move)
Similar jobs
- FA
R&D Technician, Robotics Hardware Auto Apply
Field Ai · Irvine · On-site 🇺🇸
RoboticsAssembly$30 - $55/hr - SN

Fuel Development Engineer Auto Apply
Standard Nuclear, Inc. · Oak Ridge · Hybrid 🇺🇸
Microsoft ExcelERPNetSuite+6EngineeringSalary not listed - PU

Associate Director, Drug Product, Pulmovant Auto Apply
Pulmovant · Remote · Remote 🇺🇸
ComplianceOutreachSalary not listed - OA
Senior R&D Engineer Auto Apply
Omen AI · San Francisco · Hybrid 🇺🇸
AltiumSolidWorksEngineeringSalary not listed - RE

Senior GNC Engineer Auto Apply
Redcanyonsoftware · United States · Remote 🇺🇸
Engineering$60 - $100/hr - TE
Technician, Product Development Auto Apply
Terrestrialbio · Woburn · On-site 🇺🇸
AssemblyComplianceRegulatory ComplianceSalary not listed - TL

Design Research Engineer Auto Apply
Taste Labs · San Francisco · On-site 🇺🇸
FigmaGenerative AIEngineeringSalary not listed - SA

Research Engineer, Coding Evaluation & Training Data Auto Apply
Surge Ai · United States - Remote · Remote 🇺🇸
ConcreteContinuous ImprovementSystem DesignEngineeringSalary not listed - ES

Product Engineer II - Defense Solutions Auto Apply
Esri · Charlotte · Hybrid 🇺🇸
ComplianceDiversity & InclusionGDPR+3Salary not listed - ES

Product Engineer II - Defense Solutions Auto Apply
Esri · Redlands · Hybrid 🇺🇸
ComplianceDiversity & InclusionGDPR+3Salary not listed - PA

Product Engineer Auto Apply
Paralleldomain · Remote · Remote 🇺🇸
DroneRoboticsAutonomous Driving$100k - $200k/yr - PL

Research EngineerRecently posted Auto Apply
Pramaana Labs · Palo Alto · On-site 🇺🇸
PyTorchPythonEngineeringSalary not listed