Haystack
← Back to Jobs
Employee
Engineering
TJ

LLMOps Engineer with Security Clearance

The Josef Group Inc.Chantilly, VA🇺🇸United StatesPosted 21 Jul 2026

Why This Role Stands Out

This hybrid LLMOps Engineer role offers a significant opportunity to shape cutting-edge AI infrastructure, with a competitive salary up to $250K and excellent benefits. You'll thrive if you have deep expertise in LLM operations, production deployment, and cloud environments, contributing to impactful projects within a dynamic team. Apply now to leverage your skills and advance your career in a highly sought-after field.

Quick Overview

Salary
$250k/yr
Work Type
Hybrid
Schedule
Employee
Level
Mid Senior

Job Description

LLMOps Engineer | Top Secret Clearance required - Chantilly VA Salary to 250K and great benefits! Are you passionate about building and operating production-scale Large Language Model infrastructure? We're looking for an experienced LLMOps Engineer to help deploy, optimize, and scale self-hosted AI platforms.

What we're looking for:
✅ Deep understanding of LLM internals (Transformers, tokenization, inference, quantization, fine-tuning)
✅ Hands-on experience with vLLM deployment and production operations
✅ Kubernetes, Docker, GPU clusters, and AWS, Azure, or GCP
✅ Expertise serving open-weight models like Llama, Mistral, and Qwen
✅ Experience with tensor parallelism, continuous batching, PagedAttention, KV-cache optimization, and model quantization (AWQ, GPTQ, FP8)
✅ Strong DevOps background with CI/CD, Infrastructure as Code, observability, monitoring, and incident response
✅ Proven success managing production LLM environments for performance, reliability, scalability, and cost efficiency If you've been responsible for keeping a live, self-hosted LLM platform running at peak performance, we'd love to hear from you. 📩 Contact Debbie at The Josef Group, to learn more about this exciting opportunity.

Similar jobs