Quick Overview
Job Description
As AI-powered features become central to automotive vehicles — from ADAS perception and voice assistants to predictive diagnostics and intelligent infotainment — rigorous validation of these systems is critical for successful deployment. We are seeking a Senior AI Validation Engineer to design and implement testing strategies, frameworks, and automated pipelines that ensure the quality, safety, and reliability of deep learning and LLM-based features across vehicle platforms.
This role sits at the intersection of AI/ML engineering and automotive system validation. You will build the tools, datasets, and evaluation methodologies that enable confident delivery of AI-driven automotive solutions.
Key Responsibilities:
- Design and implement validation frameworks for deep learning models (perception, NLP, generative AI) deployed in automotive systems, covering accuracy, robustness, latency, and safety metrics.
- Develop automated test pipelines for LLM-based features, including hallucination detection, response quality evaluation, prompt regression testing, and adversarial input testing.
- Build and curate evaluation datasets and benchmarks tailored to automotive AI use cases (e.g., voice commands, diagnostic Q&A, sensor fusion outputs).
- Create AI-assisted test generation tools that leverage LLMs to automatically produce test cases, test data, and expected-result specifications from system requirements.
- Develop model monitoring and drift detection systems for AI features running in production and test environments.
- Collaborate with system architects to integrate AI model validation into existing test bench infrastructure and CI/CD pipelines.
- Implement automated regression testing for ML model updates, ensuring backward compatibility and performance parity across software releases.
- Analyze test results using statistical methods and ML techniques to identify root causes, failure patterns, and quality trends.
- Work in cross-functional Agile teams spanning AI/ML, embedded software, and system integration disciplines.
Our Benefits - Designed with You in Mind
Comprehensive Health & Well-being Coverage
From your very first day, you’ll have access to medical, dental, vision, and prescription drug coverage - ensuring you and your family stay healthy and protected.
Generous Paid Time Off
We believe in work-life balance. That’s why we offer: 17+ paid holidays, including shut-down from December 24th through New Years Day every year. Vacation, float & wellbeing days, sick time and fully paid parental leave when your family needs you most.
Competitive Retirement Savings Plans
We help you plan for the future with:
- An employer match on contributions to your 401k, Roth, and Catch-Up plans
- An employer contribution, even if you don’t contribute
Income Protection & Insurance Options
Benefit from included and optional disability, life, and other insurance programs - because your peace of mind matters.
Company Vehicle Lease Program
Eligible employees and their immediate families can enjoy company vehicle lease options with included insurance, maintenance, and unlimited mileage. Plus, take advantage of exclusive discounts on Stellantis products.
Family Building Benefit
We proudly support all paths to parenthood- including fertility and infertility treatments, adoption services, and gestational surrogacy.
Support for Your Growth and Giving Back
We believe in investing in your future and your passions:
- Tuition reimbursement
- Student loan refinancing programs
- 18 paid volunteer hours each year to make a difference in your community
And so much more!
When you join us, you’re not just building a career - you’re joining a company that supports you, inside and outside of work.
Similar jobs
- RE
Network Engineer 1 with Security Clearance
NewRealmOne
Columbia, MD🇺🇸Hybrid8 hours agoEncryptionTechnology - EG
Principal Data Analyst, Data Products
NewEliassen Group
Raleigh, NC🇺🇸$69 - $72/hrHybrid8 hours agoSAFeSQLAWS+5Technology - EG
Lead Software Engineer
NewEliassen Group
Los Angeles, CA🇺🇸$65 - $70/hrRemote8 hours agoMicroservicesSQLPCI DSS+10Technology - EG
Business Systems Analyst (BSA)
NewEliassen Group
Almont, CO🇺🇸$75 - $80/hrHybrid8 hours ago401kSalesforceAgile+8Technology - EG
Lead Data Engineer - Experimentation
NewEliassen Group
Santa Monica, CA🇺🇸$83 - $93/hrOn-site8 hours agoSQLETLMachine Learning+3Technology - EG
Sr. MuleSoft Platform Developer
NewEliassen Group
Almont, CO🇺🇸$60 - $70/hrHybrid8 hours agoMicroservicesAWSAzure+1Technology