Quick overview
Job description
Raya Foundations is a new platform team that owns the shared foundation every other eng team builds on - AI infra (LLM gateway, model routing, spend tracking, code review agents), server architecture, shared libs and dev tooling, CI, security remediation. We own our own roadmap, but our goal is to listen to other developers' needs and take on work that makes our apps safer and easier to build in.
As a Senior Server Engineer on Foundations you'll drive server architecture modernization and build the AI tooling the whole eng team uses. Small team, huge surface area. ~80% roadmap, ~20% keeping the lights on. Node.js + TypeScript at consumer scale.
The ideal candidate has 5+ years of experience, has been the technical leader on past teams, thinks like an owner, builds with AI (not just alongside it), and would rather fix it for everyone than just for themselves.
We offer comprehensive medical and dental coverage, $50 a day food delivery budget, equity based employment, a great culture, learning opportunities, unlimited vacation, 12 weeks paid parental leave, and we pay all employees $1,000 a year to go somewhere in the world that they've never been because of our values of human connection, empathy, and curiosity.
Responsibilities
-
Platform Ownership: Collaborate, build, and lead key components of the shared foundation every Raya engineering team builds on: AI infrastructure (LLM gateway, model routing, spend tracking, code review agents), server architecture, shared libraries, developer tooling, and CI
-
Architecture: Drive server architecture modernization. Write the tech specs, make the trade-offs ourselves, plan the work so it ships safely, and see it through to adoption across engineering!
-
AI Tooling: Build and roll out the AI-collaborative development tooling Raya engineers use every day, from model routing and eval harnesses to cloud agents that review code and catch slop, and set the standards for how we use it
-
Engineering Standards: Set the bar the rest of engineering follows through design reviews, code review, and the docs that let other teams build with confidence
-
Operational Excellence: Own the full Software Development Life Cycle (SDLC) for what you build: CI/CD, observability and alarm coverage, security remediation, and a healthy, blameless on-call rotation. Be an escalation point for deep production debugging
-
Mentorship: Help engineers grow through pairing, code review, and direct feedback
Qualifications
-
5+ years of hands-on experience building and operating production server software, with a track record of delivering scalable and maintainable systems and growing into a technical leader within your organization
-
Demonstrated expertise in system design, architecture, and mastery in Node.js and TypeScript
-
Proven experience in building and scaling backend systems in production at a startup or fast-moving environment
-
Hands-on with MongoDB and/or PostgreSQL in production, including performance tuning
-
Experience owning platform, infrastructure, or developer-productivity work that other teams depend on (shared libraries, CI/CD, dev tooling, observability, or security remediation) and driving its adoption
-
Has built and shipped products with LLMs or AI agents in production, beyond a chat wrapper
-
Enthusiasm around new AI tools and frameworks - and a willingness to quickly adopt emerging best practices
What Sets You Apart
-
Modernizer: You've led a large architecture migration across a codebase other teams depend on, and you got it adopted
-
AI Infrastructure: Experience with LiteLLM, Amazon Bedrock, or similar model-routing layers, and with prompt engineering, evals, or fine-tuning in production
-
Infrastructure-fluent: Comfortable with AWS, Docker/Kubernetes, and CI/CD, and with the security & infra side of running a consumer product at scale
-
Leverage-minded: You'd rather fix it for everyone than just for yourself. You build the tools, workflows, and habits that maximize team velocity, and you measure whether they worked
-
Empathetic Leader: You naturally resonate with colleagues, users, and collaborative teams, fostering a culture of understanding and innovation
-
Bias toward shipping and iteration: You're able to build quickly, learn, and refine in short cycles
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- PI

Deployment EngineerRecently posted Auto Apply
Picklerobot · Greenville · On-site · Posted 17 Nov 2026 🇺🇸
GitRoboticsPython+2TechnologySalary not listed - CR

IT Support Specialist II (Huntsville AL)Recently posted Auto Apply
CFD Research Corporation · Huntsville · Hybrid · Posted 17 Nov 2026 🇺🇸
Microsoft OfficeCFDHelp Desk+1TechnologySalary not listed - IN

Data Center Technician I Auto Apply
Infraservices · Ashburn · On-site 🇺🇸
FiberMicrosoft OfficeBusiness DevelopmentTechnology$23 - $35/hr - TE

Senior Solutions Architect, CommercialRecently posted Auto Apply
Temporal · San Francisco · Remote · Posted 17 Nov 2026 🇺🇸
AWSDatabricksJava+6TechnologySalary not listed - FI
Lead Data ScientistRecently posted Auto Apply
Fi · New York · On-site · Posted 17 Nov 2026 🇺🇸
SQLDatabricksDiversity & Inclusion+1Technology$140k - $225k/yr - KR

Cyber Defence Engineer IRecently posted Auto Apply
Krakentech · Remote · Remote · Posted 17 Nov 2026 🇺🇸
OnboardingGitAWS+8TechnologySalary not listed - EH

Senior Data Platform EngineerRecently posted Auto Apply
Ellipsis Health · San Francisco - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
GCPSQLGit+22Technology$150k - $170k/yr - DD

Sr. Software Engineer in TestRecently posted Auto Apply
Ddn · Colorado Springs Office · Hybrid · Posted 17 Nov 2026 🇺🇸
GitBashJira+1TechnologySalary not listed - AT
Infrastructure EngineerRecently posted Auto Apply
Aqueduct Tech · Remote · Remote · Posted 17 Nov 2026 🇺🇸
Microsoft OfficeActive DirectoryDNS+3TechnologySalary not listed - TT
Full Stack EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 17 Nov 2026 🇺🇸
Next.jsLLMPython+4Technology$230k - $300k/yr - TT
Lead Platform EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 17 Nov 2026 🇺🇸
FastAPIMicroservicesGit+10Technology$220k - $300k/yr - TT
Fullstack Software EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 17 Nov 2026 🇺🇸
OnboardingFirebaseMongoDB+6Technology$160k - $200k/yr