Quick overview
Job description
Job Title: SR GEN AI Engineer
Location: Chicago ,IL
Duration: 12 Months + Extension
Bill Rate: $87/hour
Job Type: W-2 Contract
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD
POSITION OVERVIEW :
Job Description
We are looking for an experienced Software Engineer with strong expertise in Machine Learning, Large Language Models (LLMs), and AI infrastructure. The candidate will be responsible for designing, developing, deploying, and optimizing production-grade LLM inference services that power Generative AI applications.
The ideal candidate should have hands-on experience in model serving, inference optimization, GPU computing, and scalable Kubernetes-based infrastructure.
Key Responsibilities
- Design, develop, deploy, and maintain scalable LLM inference services.
- Optimize model serving performance, latency, throughput, and infrastructure costs.
- Work on inference optimization techniques such as Quantization (INT8/INT4, FP8, AWQ, GPTQ), KV-cache management, Paged Attention, and Prefix Caching.
- Implement and optimize model serving using TensorRT-LLM, vLLM, SGLang, or Triton Inference Server.
- Work with PyTorch and the Hugging Face ecosystem.
- Deploy and manage AI workloads using Kubernetes, Docker, and GPU scheduling.
- Build integrations with external LLM APIs and internal orchestration frameworks.
- Implement monitoring, logging, tracing, and observability using Prometheus, Grafana, Splunk, Datadog, or OpenTelemetry.
- Develop model evaluation and regression testing pipelines.
- Work with RAG pipelines and vector databases.
- Perform GPU workload cost optimization and capacity planning.
- Maintain CI/CD pipelines and Infrastructure as Code.
- Prepare technical documentation, design documents, and benchmark reports.
Required Skills
- 5+ years of overall Software Engineering experience.
- Minimum 2+ years of hands-on experience working with ML/LLM systems in production.
- Strong programming skills in Python.
- Working knowledge of Go, C++, or Rust.
- Experience with TensorRT-LLM, vLLM, SGLang, or Triton Inference Server.
- Strong understanding of LLM inference optimization and GPU performance tuning.
- Experience with PyTorch and Hugging Face.
- Hands-on experience with Kubernetes, Docker, and NVIDIA GPU infrastructure.
- Knowledge of REST APIs, gRPC, and distributed systems.
- Experience with model evaluation, performance profiling, and benchmarking.
- Understanding of CI/CD and Infrastructure as Code tools such as Terraform and Helm.
Equal Opportunity Employer: We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.
Similar jobs
- CY

AWS AI Architect | Seattle , WA or Fort Lauderdale , FL(Must be local to WA or FL) – Hybrid – Local profilesRecently posted
Cyberobotix · Seattle, WA · On-site · Posted 17 Nov 2026 🇺🇸
ShellAWSSSO+4TechnologySalary not listed - QT

AI EngineerRecently posted
QUANTUM TECHNOLOGIES LLC · United States · Hybrid · Posted 16 Nov 2026 🇺🇸
MicroservicesNLPC#+11Technology$80 - $90/hr - LS

Gen AI ArchitectRecently posted
Lincoln Softtech LLC · Dallas, TX · Hybrid · Posted 16 Nov 2026 🇺🇸
Stakeholder ManagementDockerMicroservices+14TechnologySalary not listed - IA

Forward Deployment AI EngineerRecently posted
IT Associates, Inc. · New York, NY · Hybrid · Posted 16 Nov 2026 🇺🇸
AWSSOC 2C#+6TechnologySalary not listed - AS
Enterprise IT and AI ArchitectRecently posted
Algo Soft Solutions LLC · United States · Hybrid · Posted 16 Nov 2026 🇺🇸
Microsoft OfficeEncryptionOAuth+10TechnologySalary not listed - PR
W2 - AI Engineer - Locals Only - Plano, TXRecently posted
Prohires · Plano, TX · On-site · Posted 16 Nov 2026 🇺🇸
FastAPIApache SparkDatabricks+6Technology$45/hr - TS
Senior Agentic AI Engineer Santa Clara, CA (Remote)
Triunity Software · United States · Remote 🇺🇸
SnowflakeLLMAzure+4TechnologySalary not listed - TE
GenAI Engineer - Columbia, SC, Atlanta, GA, Charlotte, NC, Raleigh, NC, Durham, NCRecently posted
TechniPros, LLC · Columbia, SC · Hybrid · Posted 17 Nov 2026 🇺🇸
FastAPIFlaskSQL+16TechnologySalary not listed - BC

Forward Deployed AI Engineer, United States - BCG XRecently posted
Boston Consulting Group · Oakland, California · Hybrid · Posted 17 Nov 2026 🇺🇸
PythonData AnalysisTechnology$120k/yr - OT
Senior AI EngineerRecently posted
Oscar Technology · United States · Remote · Posted 17 Nov 2026 🇺🇸
AWSPythonTechnology$150k - $180k/yr - QT

Azure AI EngineerRecently posted
QUANTUM TECHNOLOGIES LLC · Dallas, TX · Hybrid · Posted 17 Nov 2026 🇺🇸
DockerGitMLOps+11Technology$73/hr - HG

AI EngineerRecently posted
HTC Global Services · Madison, WI · Hybrid · Posted 16 Nov 2026 🇺🇸
NumPyScikit-learnLLM+8TechnologySalary not listed