Why This Role Stands Out
This hybrid role offers a fantastic opportunity to shape the future of AI infrastructure by validating and optimizing cutting-edge GPU technologies for enterprise clients. You'll thrive here if you have a passion for ML engineering, MLOps, and performance tuning, and are eager to develop deep expertise in distributed training and inference serving. Don't miss out on the chance to join a growing practice with significant impact!
Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
Plano, TX, United States
Posted
21 hours ago
MLOpsLLMPyTorchPythonKubernetesRAG
Job Description
Role Name :Senior Engineer AI Workload & Infrastructure Validation
Location: Plano, TX (Hybrid - 2 Days Onsite / 3 Days Remote)
Employment Type: Full-Time
Compensation: Open / Best in the Industry
Interview Mode: Virtual
Practice: AI Infrastructure / GPU-as-a-Service (GPUaaS)
Employment Type: Full-Time
Compensation: Open / Best in the Industry
Interview Mode: Virtual
Practice: AI Infrastructure / GPU-as-a-Service (GPUaaS)
Job Summary
We are seeking a Senior Engineer to drive AI workload optimization, distributed training enablement, infrastructure validation, benchmarking, and performance analysis for enterprise GPU deployments. This role will help define customer validation standards and benchmark methodologies for AI platforms.
Key Responsibilities
- Enable and optimize distributed AI training using PyTorch DDP, FSDP, DeepSpeed, and NCCL.
- Deploy and optimize inference platforms using Triton, NVIDIA NIM, vLLM, and TensorRT-LLM.
- Build benchmark and validation frameworks for GPU infrastructure.
- Perform GPU, storage, networking, and cluster performance validation.
- Produce customer-facing performance reports and acceptance documentation.
- Design proof-of-concept workloads and benchmark environments.
- Support customer AI initiatives including RAG, Fine-Tuning, Agentic AI, and Vector Database integrations.
- Establish best practices for infrastructure validation and performance engineering.
Required Qualifications
- 5+ years of experience in ML Engineering, MLOps, AI Infrastructure, or Performance Engineering.
- Hands-on experience with distributed training across multi-node GPU clusters.
- Experience deploying production LLM inference platforms.
- Strong understanding of benchmarking and performance analysis.
- Strong Python development experience.
- Experience with Kubernetes-native AI workflows.
Required Skills
PyTorch, DDP, FSDP, DeepSpeed, NCCL, Triton Inference Server,
NVIDIA NIM, vLLM, TensorRT-LLM, Python, MLOps, AI Infrastructure,
Kubernetes, Kubeflow, Ray, Argo Workflows, GPU Validation,
Performance Engineering, Benchmarking, RAG, Vector Databases,
LLM Inference, Distributed Training, AI Platform Engineering
Similar jobs
- DC
Content Internship - Spring 2027
NewDestination Cleveland
Cleveland, Ohio🇺🇸$1k/moOn-site9 minutes agoSpringMicrosoft OfficeAdobe Creative Suite+5 - FH
Client Specialist
NewFirst Horizon Bank
Birmingham, Alabama🇺🇸On-site9 minutes agoCross-sellingTreasury - DD
Dunkin' Team Member - Corinth
NewDunkin' Donuts
Corinth, Maine🇺🇸$16/hrHybrid9 minutes agoScheduling - BT
CBE Student Success Coordinator
NewBellingham Technical College
Bellingham, Washington🇺🇸$70.3k/yrOn-site9 minutes agoOnboardingMicrosoft OfficeCase Management+2 - OR
Director, Core Infrastructure Engineering
NewOracle
Nashville, Tennessee🇺🇸$169.8k - $355.4k/yrHybrid15 minutes agoOracleEncryptionCompliance+3 - SH
LIMS Master Data Specialist
NewShimento, Inc.
Houston, TX🇺🇸Hybrid21 hours ago - TE
Quality Analyst
NewTekcel8
United States🇺🇸Remote21 hours agoSQLScrumSelenium+7 - EJ
Tailored Branch Support Specialist II (CST)
Edward Jones
Saint Louis, MO🇺🇸On-site3 weeks agoMicrosoft OfficeDocument ManagementOutreach+1 - TE
Sr. IAM Analyst
NewTechDigital Corporation
New York, NY🇺🇸Hybrid21 hours agoOnboardingActive DirectoryCompliance+3 - TE
Cloud ERP – GT Consultant
NewTechDigital Corporation
San Francisco, CA🇺🇸Hybrid21 hours agoOracleERPForecasting+2 - DC
End-to-End (E2E) Test Lead
NewData Capital Inc
Seattle, WA🇺🇸Hybrid21 hours agoTriageAzureJira+1 - AT
Senior MicroStrategy Analytics Architect & Platform Administrator
NewAvinya Technologies LLC
United States🇺🇸$150k/yrRemote21 hours agoOracleSQLShell+22