Quick Overview
Job Description
About the job
FriendliAI is looking for an engineer to architect and build the security foundations of a multi-tenant serverless compute platform running on Kubernetes with hardened container isolation. As a Software Engineer, Platform Security, you will own the security design for both the control plane and data plane, implement guardrails as code, and partner closely with Platform/SRE/Infra teams to ship a secure-by-default developer experience. This is a hands-on builder and architect role.
Key Responsibilities
Design and implement the security architecture for a Kubernetes-based, multi-tenant serverless platform.
Build guardrails as code using Terraform and Helm.
Establish network segmentation and service-mesh policy.
Develop secrets and key management patterns.
Implement runtime detections for containerized workloads.
Design and roll out IAM & workload identity management.
Threat model new features and changes to the overall platform.
Collaborate with engineering to debug production issues, lead post-incident hardening, and automate evidence for compliance controls.
Qualifications
5+ years securing cloud-native platforms with a focus on distributed systems and multi-tenancy.
Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent.
Strong hands-on experience with AWS (IAM, VPC/networking, logging/monitoring, …) and Kubernetes/container security.
Proficiency with Terraform and Helm.
Experience building or operating runtime detections for containers/functions.
Strong technical background in backend systems, cloud infrastructure, or AI tooling
Clear written and verbal communication; ability to translate pricing/business rules into robust systems.
Preferred Experience
Knative or similar serverless-on-K8s frameworks.
Container hardening and sandboxing.
Policy-as-code and admission policy design at scale.
eBPF-based observability, detections, and signal tuning.
Multi-cloud exposure and cross-cloud identity approaches.
Hands-on contributions to SOC 2 / HIPAA control automation and audit evidence pipelines.
Benefits
A front-row seat to the generative AI infrastructure revolution
Competitive compensation and benefits package
Daily lunch and dinner provided; unlimited snacks and beverages
Health check-up and top-tier hardware support
Flexible working hours and a highly collaborative environment
About us
FriendliAI is building the next-generation AI inference platform that accelerates the deployment of large language and multimodal models with unmatched performance and efficiency. Our infrastructure powers high-throughput, low-latency workloads for global organizations and integrates directly with Hugging Face, providing instant access to over 600,000 open-source models. We are on a mission to deliver the world’s best platform for AI inference.
Similar jobs
- ZT
Senior Software Engineer, Data Infrastructure
NewAuto ApplyZoomInfo Technologies LLC
Bethesda🇺🇸Hybrid13 hours agoGCPHTMLAWS+12Technology - VH
Senior Software Engineer (Hybrid - New York City or San Francisco)
NewAuto ApplyVerana Health
New York NY🇺🇸$149.6k - $187k/yrHybrid10 hours agoDockerMicroservicesSpring+18Technology - XO
Senior Software Engineer
Auto ApplyXometry
North Bethesda🇺🇸Hybrid1 month agoAWSCADCompliance+4Technology - VT
Senior Software Engineer, TVision
NewAuto ApplyViant Technology
Cambridge🇺🇸$120k - $150k/yrHybrid8 hours agoAWSFlinkComputer Vision+3Technology - TR
Software Engineer / Scrum Master - PLNR (26-394)
NewAuto ApplyTrace3
Colorado Springs🇺🇸$110.0k - $120k/yrHybridYesterdaySAFeRecruitingScrum+3Technology - TR
Software Engineer (GAITS - Analyst Team) (26-386)
NewAuto ApplyTrace3
Colorado Springs🇺🇸$110.0k - $120k/yrHybridYesterdayRecruitingMATLABScrum+5Technology - VS
Software Development Engineer III, MuleSoft
NewAuto ApplyVeeam Software
Remote🇺🇸Remote10 hours agoSQLEncryptionOAuth+9Technology - VE
Senior Software Engineer, Developer AI
NewAuto ApplyVerkada
San Mateo🇺🇸Hybrid11 hours agoMental HealthPythonTechnology - SA
Staff Software Engineer, Constraint Generation
NewAuto ApplyStack AV
Pittsburgh🇺🇸RemoteYesterdayRoboticsAutonomous DrivingC+++2Technology - SA
Staff Software Engineer, Trajectory Generation & Controls
NewAuto ApplyStack AV
Pittsburgh🇺🇸RemoteYesterdayRoboticsAutonomous DrivingC+++3Technology - SP
Lead Software Engineer, Application Software (Procurement)
NewAuto ApplySpaceX
Hawthorne🇺🇸Hybrid4 hours agoSQLAngularC#+10Technology - SP
Sr. Core Integration Engineer (Starlink Mobile)
NewAuto ApplySpaceX
Redmond🇺🇸HybridYesterdaySVNGit5G+4Technology