Start searching
Back to Jobs
Recently postedEmployeeTechnology

Junior Software Engineer – Inference with Security Clearance

Neural SolutionsColumbia, MD🇺🇸United States

Why this role stands out

This hybrid Junior Software Engineer role offers an exceptional opportunity to build and maintain cutting-edge AI infrastructure, with a competitive salary range of $138,000-$163,000, perfect for ambitious engineers eager to grow their skills in a dynamic, security-focused environment. You'll thrive here if you possess strong Python and cloud experience, enjoy collaborative problem-solving, and are keen to contribute to impactful AI solutions. Apply now to join a reputable company and advance your career in the exciting field of AI!

Quick overview

Salary$138k - $163k/yr
SeniorityJunior
Employment typeEmployee
Work modeHybrid
LocationColumbia, MD, United States
DockerAWSGrafanaHelmLLMPrometheusPythonKubernetesCI/CD

Job description

We are seeking a software engineer to support our AI infrastructure team at Neural Solutions. You will help build and maintain the foundation for advanced AI capabilities, ensuring high-quality language model (LLM) access throughout the inference software stack.

Responsibilities

  • Procure, configure, and test new inference models, preparing them for release to our user base.
  • Develop in-house services and techniques to ensure continuous high-quality inference service.
  • Collaborate with model vendor teams to create reliable pipelines for closed-source model usage.
  • Support surge efforts to meet short-term, high-priority inference needs from our customer.
  • Engage with other teams to establish robust infrastructure and integrate LLM-powered tools.

Required Skills

  • Experience with Python or other modern programming languages.
  • Familiarity with Argo CD or other CI/CD frameworks.
  • Experience with Kubernetes/Helm.
  • Familiarity with AWS or other cloud service providers.
  • Ability to learn new technologies quickly.
  • Strong communication skills and willingness to ask questions. Nice to Have:
  • Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
  • Experience with other LLM hosting frameworks and practices.
  • Experience supporting production software using Site Reliability Engineering (SRE) best practices.
  • Familiarity with Elastic, Grafana/Prometheus, or other observability frameworks.
  • Experience with Docker and containerization.
  • Experience in traffic shaping and quality-of-service engineering.

Experience Required: 3 years with Bachelor’s degree in a technical field, or 7 years without degree Location: Columbia, MD Clearance: TS/SCI with Polygraph required Salary Range: $138,000 - $163,000

Similar jobs

Apply