Back to Jobs
Recently postedRemoteFull timeTechnology

Senior Server Engineer, Foundations

RayaRemote🇺🇸United States

Quick overview

Salary$1k/mo
SeniorityMid Senior
Employment typeFull Time
Work modeRemote
LocationRemote, United States
DockerMongoDBAWSLLMNode.jsPostgreSQLKubernetesTypeScriptPrompt EngineeringCI/CDSystem Design

Job description

Raya Foundations is a new platform team that owns the shared foundation every other eng team builds on - AI infra (LLM gateway, model routing, spend tracking, code review agents), server architecture, shared libs and dev tooling, CI, security remediation. We own our own roadmap, but our goal is to listen to other developers' needs and take on work that makes our apps safer and easier to build in.

As a Senior Server Engineer on Foundations you'll drive server architecture modernization and build the AI tooling the whole eng team uses. Small team, huge surface area. ~80% roadmap, ~20% keeping the lights on. Node.js + TypeScript at consumer scale.

The ideal candidate has 5+ years of experience, has been the technical leader on past teams, thinks like an owner, builds with AI (not just alongside it), and would rather fix it for everyone than just for themselves.

We offer comprehensive medical and dental coverage, $50 a day food delivery budget, equity based employment, a great culture, learning opportunities, unlimited vacation, 12 weeks paid parental leave, and we pay all employees $1,000 a year to go somewhere in the world that they've never been because of our values of human connection, empathy, and curiosity.

Responsibilities

  • Platform Ownership: Collaborate, build, and lead key components of the shared foundation every Raya engineering team builds on: AI infrastructure (LLM gateway, model routing, spend tracking, code review agents), server architecture, shared libraries, developer tooling, and CI

  • Architecture: Drive server architecture modernization. Write the tech specs, make the trade-offs ourselves, plan the work so it ships safely, and see it through to adoption across engineering!

  • AI Tooling: Build and roll out the AI-collaborative development tooling Raya engineers use every day, from model routing and eval harnesses to cloud agents that review code and catch slop, and set the standards for how we use it

  • Engineering Standards: Set the bar the rest of engineering follows through design reviews, code review, and the docs that let other teams build with confidence

  • Operational Excellence: Own the full Software Development Life Cycle (SDLC) for what you build: CI/CD, observability and alarm coverage, security remediation, and a healthy, blameless on-call rotation. Be an escalation point for deep production debugging

  • Mentorship: Help engineers grow through pairing, code review, and direct feedback

Qualifications

  • 5+ years of hands-on experience building and operating production server software, with a track record of delivering scalable and maintainable systems and growing into a technical leader within your organization

  • Demonstrated expertise in system design, architecture, and mastery in Node.js and TypeScript

  • Proven experience in building and scaling backend systems in production at a startup or fast-moving environment

  • Hands-on with MongoDB and/or PostgreSQL in production, including performance tuning

  • Experience owning platform, infrastructure, or developer-productivity work that other teams depend on (shared libraries, CI/CD, dev tooling, observability, or security remediation) and driving its adoption

  • Has built and shipped products with LLMs or AI agents in production, beyond a chat wrapper

  • Enthusiasm around new AI tools and frameworks - and a willingness to quickly adopt emerging best practices

What Sets You Apart

  • Modernizer: You've led a large architecture migration across a codebase other teams depend on, and you got it adopted

  • AI Infrastructure: Experience with LiteLLM, Amazon Bedrock, or similar model-routing layers, and with prompt engineering, evals, or fine-tuning in production

  • Infrastructure-fluent: Comfortable with AWS, Docker/Kubernetes, and CI/CD, and with the security & infra side of running a consumer product at scale

  • Leverage-minded: You'd rather fix it for everyone than just for yourself. You build the tools, workflows, and habits that maximize team velocity, and you measure whether they worked

  • Empathetic Leader: You naturally resonate with colleagues, users, and collaborative teams, fostering a culture of understanding and innovation

  • Bias toward shipping and iteration: You're able to build quickly, learn, and refine in short cycles

Haystack's AI agent can fill in and submit this application for you. How AI auto apply works