Quick Overview
Salary
$180k - $200k/yr
Seniority
Mid Senior
Work mode
Hybrid
Location
Waltham, MA, United States
Posted
Yesterday
MicroservicesMachine LearningGenerative AIJavaLLMPython
Job Description
Job Description A rapidly growing insurance technology organization is seeking an AI Engineer to help design, build, and scale next-generation AI-powered customer experiences. This role is ideal for a backend-focused engineer with strong experience productionizing machine learning and large language model solutions in cloud-based environments.
You will be responsible for developing reliable AI systems, integrating LLMs into production applications, building the supporting infrastructure and evaluation frameworks, and ensuring performance, scalability, and observability across AI-driven services. The position offers the opportunity to own AI features from concept through deployment while collaborating closely with product and engineering teams.
This is a hybrid position based in the Waltham, Massachusetts area, requiring a minimum of three days per week onsite. Required Skills & Experience
You will be responsible for developing reliable AI systems, integrating LLMs into production applications, building the supporting infrastructure and evaluation frameworks, and ensuring performance, scalability, and observability across AI-driven services. The position offers the opportunity to own AI features from concept through deployment while collaborating closely with product and engineering teams.
This is a hybrid position based in the Waltham, Massachusetts area, requiring a minimum of three days per week onsite. Required Skills & Experience
- 4+ years of backend software engineering experience using Python, Go, Java, or similar languages
- 4+ years of hands-on experience integrating machine learning or large language models into production environments
- Experience building and maintaining backend services, APIs, or microservices
- Strong understanding of distributed systems and high-performance application design
- Knowledge of cloud infrastructure and modern software architecture patterns
- Experience evaluating AI or ML model performance using established metrics and quality frameworks
- Familiarity with observability, monitoring, and production support practices
- Ability to troubleshoot issues across model serving, backend systems, and AI workflows
- Strong communication and cross-functional collaboration skills
- Ability to thrive in fast-paced and evolving environments
- Experience building end-to-end generative AI applications
- Knowledge of real-time inference and serving infrastructure
- Experience creating AI evaluation, testing, or monitoring frameworks
- Background in enterprise-scale cloud platforms
- Exposure to AI governance, reliability, and operational best practices
- Passion for innovation and continuous technical improvement
- 100% Hands On
- Design and develop backend systems that power AI-driven products and services
- Integrate ML and LLM models into production applications with a focus on reliability, scalability, and performance
- Own AI capabilities throughout the full development lifecycle, from architecture through deployment
- Build, maintain, and improve AI quality, evaluation, and monitoring frameworks
- Develop and support APIs, microservices, and real-time serving infrastructure
- Diagnose and resolve issues across backend components, model serving layers, and AI workflows
- Partner with product managers and engineering teams to translate business requirements into technical solutions
- Participate in architecture discussions, code reviews, and system design initiatives
- Drive technical innovation and identify opportunities to improve AI platform capabilities
- Base Salary: $180,000 - $200,000 USD
- Annual performance-based incentive opportunity
- Flexible hybrid work arrangement
- Comprehensive employee benefits package
- Medical Insurance
- Dental Benefits
- Vision Benefits
- Paid Time Off (PTO)
- 401(k)
- Life Insurance
- Disability Insurance
- Parental Leave
Similar jobs
- AG
Gen AI Engineer
NewAIT Global, Inc.
Evanston, IL🇺🇸RemoteYesterdayLLMPythonTechnology - DI
Junior Cloud / AI Developer - Remote
NewDivIHN Integration Inc.
United States🇺🇸RemoteYesterdayDockerEncryptionAgile+5Technology - TE
Mastra.Ai Developer
NewTechno-Comp, Inc.
United States🇺🇸RemoteYesterdayLLMTypeScriptTechnology - IS
Senior AI Engineer
NewISOFT
United States🇺🇸HybridYesterdayMicroservicesOAuthAzure+8Technology - AG
Azure AI Engineer Developer – W2 Only
NewASCII Group LLC
Edison, NJ🇺🇸$65/hrOn-siteYesterdayMachine LearningAzureTechnology - CE
Junior AI Developer
Computer Enterprises, Inc.
Cleveland, OH🇺🇸On-site6 weeks agoTechnology