Quick overview
Job description
About the Role
Join a platform engineering team building and operating large-scale data infrastructure for a B2B AI technology company. You will help make data ingestion, storage, and retrieval reliable, scalable, and secure.
What You'll Do
Design, build, and operate data infrastructure for petabyte-scale ingestion, storage, indexing, and retrieval.
Make architecture decisions across hot and cold storage, distributed databases, vector stores, and high-throughput messaging and streaming systems.
Run and scale containerized services on orchestration platforms, using declarative configuration and GitOps workflows.
Build and maintain CI/CD pipelines, infrastructure as code, and deployment tooling.
Support secure, auditable, reliable systems in federal or other regulated environments.
Debug and tune systems across application code, storage, and networking, and mentor engineers through reviews, pairing, and technical guidance.
Own production systems end to end, from architecture and implementation through deployment and on-call operations.
What We're Looking For
5 to 10 years of experience, including at least 5 years building and maintaining production software systems.
Hands-on experience building and operating large-scale data stores, including ingestion, hot and cold storage, and retrieval, as well as production data pipelines.
Strong AWS and distributed systems experience, with backend or distributed systems work alongside any front-end experience.
Experience with Docker, Kubernetes, Terraform, CI/CD, Python, Go, PostgreSQL, Kafka, vector databases, and Rust or C/C++.
A DevOps foundation in infrastructure as code, observability, and automated deployments, plus experience owning production systems.
Federal or regulated-environment experience is a plus; experience with performance-critical code in Rust, Go, or C++ is also valued.
Compensation & Benefits
Base salary: $175,000 to $220,000 annually. Visa sponsorship is not available; candidates must be authorized to work in the United States without sponsorship.
Location
Hybrid in New York, New York, United States.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free