Haystack
← Back to Jobs
Full time
Other
LA

Search Engineer, AI Infrastructure (SF/Toronto)

LavendoSan Francisco🇺🇸United StatesPosted Sep 24, 2026

Why This Role Stands Out

You'll have a significant impact by owning ranking quality for an LLM-driven search product at a rapidly growing Series B startup with impressive ARR and open-source traction. This role is ideal for experienced search engineers passionate about production ranking and eager to contribute to a fast-paced, innovative environment. Apply now to help build the future of AI data retrieval!

Quick Overview

Salary
$235k - $260k/yr
Seniority
Mid Senior
Employment type
Full Time
Work mode
On Site
Location
San Francisco, United States
Posted
13 hours ago
RustCADLLMPythonREST

Job Description

Lavendo partners with startups and high‑growth companies to help them hire top‑tier sales, GTM, and technical talent. This role is with one of our clients; we’ll share full details about the company and interview process as we get to know you and confirm mutual fit.

About the Company

Our client builds the data layer that AI agents run on. One API call turns any URL into clean, structured, LLM-ready data. It is already the default way a huge number of developers pull web data into their AI systems.

The numbers back it up: 8 figures in ARR in year one, more than doubled that in year two, and 180,000+ GitHub stars, placing its open-source project among the top 50 repositories of all time. They just closed a $75M Series B. The company is small, moving fast, and hiring people who want to build the next chapter with them.

The Mission

They believe developers and AI agents should not have to fight the web to get useful data out of it. Every hour spent maintaining a scraper, dealing with stale pages, or working around brittle retrieval systems is an hour taken away from the actual product.

Their job is to make that problem disappear: give AI systems reliable access to the live web, then make the results clean, current, structured, and useful enough to power real products.

The Opportunity

As a Search Engineer, you will own ranking quality and relevance for an LLM-driven search and retrieval product.

This is a role for an engineer whose primary, hands-on discipline is production search quality. You have personally shipped ranking or re-ranking changes, measured their impact, and can clearly describe the relevance, recall, conversion, or other search-quality metric you improved—including the result.

You will work directly with the Head of Search and a small team across crawling, indexing, retrieval, and search serving. These systems are central to delivering excellent results at scale, but they are not substitutes for relevance ownership. Your role is to improve search quality while navigating the real constraints of web-scale retrieval: freshness, deduplication, latency, reliability, and cost per query.

What You’ll Do

  • Own ranking quality and relevance for LLM-driven retrieval

  • Design and build the crawling, indexing, and retrieval systems

  • Push down latency and cost per query while search volume grows

  • Own services end to end: design, ship, monitor, and iterate in production

  • Work directly with the Head of Search and the rest of the search team on the roadmap

What You Bring

  • 3+ years of experience building and operating search or retrieval systems in production, with ranking and relevance as your primary, owned discipline

  • A specific example of a ranking or re-ranking change you personally owned, the search-quality or business metric it moved, and the numerical impact achieved

  • Hands-on information-retrieval depth across BM25 and lexical retrieval, semantic/vector retrieval, hybrid retrieval, re-ranking, retrieval evaluation, or RAG evaluation

  • Experience measuring search quality through relevance, recall, conversion, CTR, NDCG, MRR, query satisfaction, or comparable production metrics

  • End-to-end ownership of search services: you have designed, shipped, monitored, debugged, measured, and iterated on production systems

  • Strong backend systems programming skills in Go, Rust, Python, or a comparable language.

  • Experience balancing relevance, latency, cost, correctness, and reliability under real production constraints

  • Comfort working through ambiguity, setting technical direction, and shipping quickly with a build-measure-iterate operating style

Key Success Drivers

The people who do well here have personally owned search quality in production, think end-to-end about relevance, crawling, indexing, serving, latency, and cost, and thrive in ambiguity by shipping, measuring, and iterating quickly without needing a fully defined playbook.

Why Join?

  • Compensation & Equity:

    San Francisco: $235,000–$260,000 USD base salary, plus competitive equity.

    Toronto: $217,000–$233,000 CAD base salary, plus competitive equity.

  • Traction: 8 figures in ARR in year one, more than doubled in year two. 180,000+ GitHub stars and a developer base showing up before you even start selling to them. $75M Series B closed in 2026, backed by top-tier investors

  • Team: ~40 people total, real visibility with the founders and leadership. No layers, no committees, fast decisions, short feedback loops

  • Benefits: 100% employer-paid medical, dental, and vision (50% for spouse and kids); employer-paid life, short-term, and long-term disability insurance; 401(k), pre-tax FSA, and commuter benefits; pet insurance; 15+ days PTO; 12 weeks fully paid parental leave for moms and dads; $100/month wellness stipend; $1,000/year learning and development budget; 3-month paid sabbatical after 4 years; team offsites twice a year; SF HQ perks and a loaner e-bike for commuting

  • Visa: not open to visa sponsorship on this one (Candidates must be authorized to work in the United States or Canada).

Interviewing Process

  1. Intro Chat

  2. Technical Chat

  3. Founders Chat

  4. Paid Work Trial (~40 hours)

We are proud to be an equal opportunity workplace and consider all qualified applicants without regard to race, color, religion, national origin, age, sex, marital status, ancestry, disability, genetic information, veteran or military status, gender identity or expression, sexual orientation, or any other characteristic protected by law.

Similar jobs