Why this role stands out
As a Software Engineer on Julius's infrastructure team, you'll build and scale secure, high-performance container sandboxes powering AI coding agents for millions of users, offering significant career growth and a chance to work with top-tier investors and founders. This role is ideal for experienced engineers who thrive on complex distributed systems, enjoy optimizing for reliability and performance, and are eager to make a substantial impact at a revenue-generating AI lab with competitive compensation and meaningful equity. Apply today to shape the future of AI development!
Quick overview
Job description
Compensation: Competitive base salary and meaningful equity
Benefits: Health & dental insurance, gym reimbursement, daily team meals, commuter benefits
We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes (isolated remote containers) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.
The Role
Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP). We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.
What You’ll Do
Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.
Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.
Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.
Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.
What You Bring
Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.
Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).
Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).
Security best practices for containerized, multi‑tenant systems.
Nice to Have
gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).
You’ve built an AI side project and enjoy tinkering with LLMs.
Why Julius
Small, senior team; massive impact surface; hard infra problems at meaningful scale.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- NT

Firmware/Embedded Software Engineer Intern - Summer 2027Recently posted Auto Apply
Neros Technologies · Torrance · Hybrid · Posted 22 Nov 2026 🇺🇸
DroneGitEmbedded Systems+5Technology$55/hr - AI

Systems Engineer, EWRecently posted Auto Apply
Anduril Industries · Costa Mesa · Hybrid · Posted 21 Nov 2026 🇺🇸
5GComplianceComputer Vision+5Technology$147k - $196k/yr - SL
Founding Engineer, ProductRecently posted Auto Apply
Sylvan Labs · New York · On-site · Posted 21 Nov 2026 🇺🇸
Next.jsHubSpotServiceNow+2Engineering$200k - $300k/yr - TT
Open Source ContributorRecently posted Auto Apply
True Talent Solutions Partners · United States · Remote · Posted 21 Nov 2026 🇺🇸
RustEmbedded SystemsC+++4$60 - $120/hr - TT
Software Engineer, Backend FocusRecently posted Auto Apply
True Talent Solutions Partners · Redwood City · On-site · Posted 21 Nov 2026 🇺🇸
Google CloudLLMTechnology$160k - $200k/yr - TT
Staff Software Engineer, Biller WorkflowsRecently posted Auto Apply
True Talent Solutions Partners · Mountain View · On-site · Posted 21 Nov 2026 🇺🇸
FastAPIPythonREST+3Technology$210k - $275k/yr - TT
Senior Software Engineer, InfrastructureRecently posted Auto Apply
True Talent Solutions Partners · United States · Remote · Posted 21 Nov 2026 🇺🇸
DockerGCPAWS+6Technology$250k - $325k/yr - TT
Staff Software Engineer, OfficeJSRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 21 Nov 2026 🇺🇸
Microsoft OfficeHTMLCSS+3Technology$231k - $340k/yr - TT
Senior Software Engineer, InfrastructureRecently posted Auto Apply
True Talent Solutions Partners · Palo Alto · On-site · Posted 21 Nov 2026 🇺🇸
AWSETLJava+4Technology$200k - $300k/yr - TT
Senior Software EngineerRecently posted Auto Apply
True Talent Solutions Partners · United States · Remote · Posted 21 Nov 2026 🇺🇸
MicroservicesSQLBlockchain+4Technology$147.5k - $195k/yr - TT
Robotics Infrastructure EngineerRecently posted Auto Apply
True Talent Solutions Partners · Pittsburgh · On-site · Posted 21 Nov 2026 🇺🇸
DockerGCPAWS+5Technology$100k - $300k/yr - PA

Forward Deployed EngineerRecently posted Auto Apply
Payabli · Remote · Hybrid · Posted 21 Nov 2026 🇺🇸
PCI DSSAccount ManagementC#+6EngineeringSalary not listed
