Haystack
← Back to Jobs
Technology

Software Engineer (Rust)

SM Global IT LLCBellevue, WA🇺🇸United StatesPosted 22 Jul 2026

Why This Role Stands Out

You'll architect and optimize a cutting-edge AI security plane using Rust, driving significant impact with a focus on performance and scalability in a hybrid environment. This role is ideal for experienced engineers who thrive on solving complex technical challenges and taking ownership of critical projects. Apply now to contribute to innovative technology and grow your expertise!

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

 

Responsibilities:

  • Architect, develop, and optimize a low-latency, high-throughput AI Security plane utilizing Rust, specifically leveraging its async/await model for highly efficient I/O and service-oriented architecture
  • Build resilient, distributed, and scalable systems, emphasizing concurrency, fault tolerance, and robust messaging protocols
  • Implement and maintain gRPC services and APIs to ensure seamless integration of the AI Security plane with control and orchestration infrastructure
  • Systematically enhance performance across the entire stack, including LLM models, by employing profiling tools for both kernel-space and user-space components
  • Lead complex, multi-functional projects and initiatives, defining the technical roadmap and driving execution across teams

 

Additional Responsibilities:

  • You thrive in ambiguity, comfortable building the path as you walk it. You thrive in a dynamic environment, seeing ambiguity not as a hindrance, but as the raw material to build something meaningful.
  • You act like an owner. Your passion for the mission fuels your bias for action. You operate with integrity because you genuinely care about the outcome. True ownership involves leveraging dynamic range: the ability to navigate seamlessly between high-level strategy and hands-on execution.
  • You are a problem-solver. You love running towards the challenges because you are laser-focused on finding the solution, knowing that solving the hard problems delivers the biggest impact.
  • You are a high-trust collaborator. You are ambitious for the team, not just yourself. You embrace our challenge culture by giving and receiving ongoing feedback—knowing that candor delivered with clarity and respect is the truest form of teamwork and the fastest way to earn trust.
  • You are a learner. You have a true growth mindset and are obsessed with your own development, actively seeking feedback to become a better partner and a stronger teammate. You love what you do and you do it with purpose.

 

Minimum Qualifications:

  • Foundational understanding of AI/ML technologies and experience leveraging, securing, or positioning AI-driven solutions to optimize outcomes within your functional domain
  • 8+ years of software engineering experience
  • Deep experience in systems programming using Rust, with a focus on asynchronous frameworks such as Tokio or async-std
  • Proven ability to design and implement horizontally scalable, highly available, and observable distributed systems
  • Strong command of Linux internals (including kernel-user space interaction, networking, sockets, and namespaces) combined with skill in performance instrumentation, containerized environments, Git workflows, and CI/CD pipelines

 

Preferred Qualifications:

  • Experience architecting real-time threat detection, input/output sanitization, or guardrail execution frameworks specifically tailored for protecting LLM and generative AI applications
  • Expert in systems languages such as C/C++ or Rust with a focus on performance optimization, including deep understanding of Linux networking stacks, Kubernetes networking, service meshes, and LLM model optimization
  • Practical experience with gRPC, Protobufs, and L4-L7 networking protocols, including TCP/IP, TLS, QUIC, HTTP, and WebSockets (WSS)

Skills

Rust
TCP/IP
C++
Generative AI
Git
HTTP
Kubernetes
LLM
gRPC

Similar jobs