Haystack
← Back to Jobs
Full time
Technology
TATypesafe Ai logo

Member of Technical Staff, Infrastructure (Kubernetes Specialist)

Typesafe AiSan Francisco Office🇺🇸United StatesPosted Mar 6, 2026

Why This Role Stands Out

This role offers an exceptional opportunity to shape the global infrastructure for cutting-edge AI, working with a world-class team from top AI labs. You'll thrive here if you're driven to build and operate scalable systems, solve complex networking challenges, and contribute to a company revolutionizing AI's real-world applications. Don't miss your chance to be at the forefront of AI infrastructure development.

Quick Overview

Salary
$150k - $250k/yr
Seniority
Mid Senior
Employment type
Full Time
Work mode
On Site
Location
San Francisco Office, United States
Posted
7 months ago
AWSEnvoyLoad BalancingService MeshDNSIstioKubernetesLLMPulumiPythonTerraform

Job Description

About TypeSafe

We’re building prod, not god. TypeSafe is an AI lab pushing frontier model intelligence in a new direction, starting with System One Models. We combine the reasoning of LLMs with the reliability of code, for truly trustworthy AI. Our first model, Jev, launched in September 2026.

While others chase leaderboards, we’re rebuilding the LLM stack from first principles to make models smarter and also dependable enough to run in production. We’re a small, fast team backed by an $870M Series A led by a16z. Made in SF, with love. Come join the frontier.

About the role

We're looking for an Infrastructure Engineer to build and operate the infrastructure behind TypeSafe AI's products at global scale. You'll own the systems that serve millions of users across regions — from provisioning Kubernetes clusters across multiple clouds to optimizing networking for low-latency AI inference.

This is a high-impact role on a small, fast-moving team. You'll work across the full infrastructure stack: cloud primitives, container orchestration, networking, observability, and the specialized infra that makes large-scale model inference efficient.

What you'll do

  • Design, deploy, and operate Kubernetes clusters across multiple regions and clouds

  • Build and maintain infrastructure for the platform that powers LLM inference workloads globally

  • Own networking, including VPCs, peering, load balancing, DNS, service mesh, CNI

  • Manage GPU infrastructure and autoscaling for ML workloads

  • Write and maintain infrastructure as code (Pulumi / Python)

  • Operate and improve observability: monitoring, alerting, tracing, logging

Requirements

  • Deep experience with Kubernetes in production at scale: networking, storage, scheduling, upgrades

  • Strong background in AWS

  • Hands-on experience with infrastructure as code (Pulumi, Terraform, or similar)

  • Solid understanding of Linux networking

  • Track record with high-traffic production ML systems

  • Programming fluency, Python preferred

Nice to have

  • Experience with large-scale LLM / ML inference infrastructure (GPU scheduling, model serving, vLLM, KubeRay, Kubernetes-native tooling)

  • Kubernetes networking depth with Cilium or other CNI plugins; service mesh (Istio, Envoy)

  • Multi-cloud infrastructure

  • Background in site reliability engineering including SLOs, incident response, capacity planning

Life at TypeSafe

We’re a small, flat, close-knit team working to make intelligence dependable enough to become part of everyday software. We work fully in person from our San Francisco office near Embarcadero station. We love what we do and care deeply about the work.

We strive for excellence and craftsmanship and won’t stop until we get there. When the team wins, we all win, and we enjoy collaborating and inspiring each other to grow—as a team and as individuals.

We value emotional honesty, kindness, and bringing your whole self to work. We build machines; we don’t try to be machines.

We want TypeSafe to be the place where you do the most impactful work of your career and help define our future as a company.

We provide

  • 100% covered health insurance

  • Daily lunch and dinner

  • Visa sponsorships

  • 401K plans

Similar jobs