← Back to Jobs
Technology
Senior software engineer (Rust, Asynchronous frameworks, distributed systems, linux internals, AI security)
FervorlySan Jose, CA🇺🇸United StatesPosted 21 Jul 2026
Quick Overview
Work Type
Hybrid
Level
Mid Senior
Job Description
Bellvue, WA or San Jose, CA (Hybrid)
Sr. Staff Software Development Engineer-AI Security (Network, Security, LLM)
What you’ll do (Role Expectations)
- Architect, develop, and optimize a low-latency, high-throughput AI Security plane utilizing Rust, specifically leveraging its async/await model for highly efficient I/O and service-oriented architecture
- Build resilient, distributed, and scalable systems, emphasizing concurrency, fault tolerance, and robust messaging protocols
- Implement and maintain gRPC services and APIs to ensure seamless integration of the AI Security plane with control and orchestration infrastructure
- Systematically enhance performance across the entire stack, including LLM models, by employing profiling tools for both kernel-space and user-space components
- Lead complex, multi-functional projects and initiatives, defining the technical roadmap and driving execution across teams
Who You Are (Success Profile)
- You thrive in ambiguity. You''re comfortable building the path as you walk it. You thrive in a dynamic environment, seeing ambiguity not as a hindrance, but as the raw material to build something meaningful.
- You act like an owner. Your passion for the mission fuels your bias for action. You operate with integrity because you genuinely care about the outcome. True ownership involves leveraging dynamic range: the ability to navigate seamlessly between high-level strategy and hands-on execution.
- You are a problem-solver. You love running towards the challenges because you are laser-focused on finding the solution, knowing that solving the hard problems delivers the biggest impact.
- You are a high-trust collaborator. You are ambitious for the team, not just yourself. You embrace our challenge culture by giving and receiving ongoing feedback—knowing that candor delivered with clarity and respect is the truest form of teamwork and the fastest way to earn trust.
- You are a learner. You have a true growth mindset and are obsessed with your own development, actively seeking feedback to become a better partner and a stronger teammate. You love what you do and you do it with purpose.
What We’re Looking for (Minimum Qualifications)
- Foundational understanding of AI/ML technologies and experience leveraging, securing, or positioning AI-driven solutions to optimize outcomes within your functional domain
- 8+ years of software engineering experience
- Deep experience in systems programming using Rust, with a focus on asynchronous frameworks such as Tokio or async-std
- Proven ability to design and implement horizontally scalable, highly available, and observable distributed systems
- Strong command of Linux internals (including kernel-user space interaction, networking, sockets, and namespaces) combined with skill in performance instrumentation, containerized environments, Git workflows, and CI/CD pipelines
What Will Make You Stand Out (Preferred Qualifications)
- Experience architecting real-time threat detection, input/output sanitization, or guardrail execution frameworks specifically tailored for protecting LLM and generative AI applications
- Expert in systems languages such as C/C++ or Rust with a focus on performance optimization, including deep understanding of Linux networking stacks, Kubernetes networking, service meshes, and LLM model optimization
- Practical experience with gRPC, Protobufs, and L4-L7 networking protocols, including TCP/IP, TLS, QUIC, HTTP, and WebSockets (WSS)
Skills
Rust
TCP/IP
C++
Generative AI
Git
HTTP
Kubernetes
LLM
gRPC
Similar jobs
Senior System Software Engineer - AV Platform
NVIDIA Corporation · Santa Clara, United States
50 minutes ago$152k - $287.5k/yrSoftware Engineer, Asset Management
TIAA · New York, United States
1 hour ago$143.5k - $195k/yrSenior System Software Engineer, NvSci
NVIDIA Corporation · Santa Clara, United States
1 hour ago$184k - $356.5k/yr(Senior) Principal Software Engineer - Navigation
Judge Group, Inc. · Los Angeles, United States
1 hour ago$100 - $140/hrSenior Process Automation Software Developer - C#/.NET (Hybrid)
Motus Recruiting & Staffing · Vancouver, United States
2 hours agoPrincipal Software Engineer
CCS Global Tech · United States
2 hours ago$160k - $260k/yr