Senior Software Engineer – Inference with Security Clearance

Join us in building the next generation of AI infrastructure that will power innovation across our organization. We’re seeking a senior software engineer to support our AI infrastructure team. In this role, you’ll help build and maintain the foundation for AI capabilities while supporting a broader ecosystem of AI-enabled applications.

Responsibilities

• Lead the evaluation, configuration, and deployment of inference models for our users.
• Mentor engineers and grow development best practices and standards for the team.
• Develop in-house services and techniques to guarantee continual high-quality inference service.
• Collaborate with other teams to establish solid infrastructure for our services and integrate LLM-powered tools.
• Support short-term, high-priority inference needs from stakeholders through coordinated efforts.

Required Skills

• Experience with Python or other modern programming languages.
• Experience with Argo CD or other CI/CD frameworks.
• Familiarity with Kubernetes/Helm.
• Experience with AWS or another cloud service provider.
• Strong communication skills and ability to mentor other engineers.
• Excellent leadership and stakeholder management skills. Nice to Have:
• Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
• Familiarity with Site Reliability Engineering (SRE) best practices for production software support.
• Knowledge of Elastic, Grafana/Prometheus, or other observability frameworks and practices.

Experience Required: 12 years with Bachelor’s degree in a technical field, or 16 years without degree Location: Columbia, MD Clearance: TS/SCI with Polygraph required Salary Range: $204,000 - $247,000