Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
Austin, TX, United States
Posted
17 hours ago
Machine LearningNLPPython
Job Description
JD:
Required Qualifications:
- 5+ years of software engineering experience with Python or similar programming languages
- Hands-on experience with LLMs and prompt engineering
- Strong understanding of AI evaluation methodologies and quality metrics
- Excellent written and verbal communication skills
- Experience with version control, CI/CD, and modern software development practices
- Ability to manage multiple projects in a fast-paced environment
Key Responsibilities:
- Design, test, and optimize prompts for AI-powered products
- Build and maintain evaluation frameworks to measure model quality and consistency
- Collaborate with product, research, and safety teams to support feature development and model releases
- Develop tools and infrastructure to improve prompt development and testing workflows
- Mentor engineers on prompt engineering best practices
- Support rapid experimentation and continuous improvement of AI systems
Preferred Qualifications:
- Experience with Claude or other frontier AI models
- Background in Machine Learning, NLP, or related fields
- Experience with A/B testing and experimentation frameworks
- Familiarity with AI safety and alignment concepts
- Experience building tools and infrastructure for AI/ML workflows
Similar jobs
- JM
Lead Software Engineer - AI Developer/Architect
NewJ.P. Morgan
Jersey City, New Jersey🇺🇸On-site47 minutes agoGCPOracleSpring+9Technology - SO
Enterprise AI Architect
NewSystem One
Lafayette, LA🇺🇸$152k/yrOn-site17 hours agoAWSGenerative AITechnology - CO
AI Engineer
NewCollabera LLC
Charlotte, NC🇺🇸$65/hrHybrid17 hours agoMicroservicesLLMPython+1Technology - KR
AI/ML Lead
NewK-Tek Resourcing LLC
Charlotte, NC🇺🇸Hybrid17 hours agoDockerAWSMLOps+15Technology - CA
Agentic AI Architect
NewCapgemini America, Inc.
United States🇺🇸Hybrid17 hours agoAzureLLMTechnology - LE
Senior AI Engineer / Architect
NewLemon.io
United States🇺🇸Remote17 hours agoFirebaseNext.jsNode.js+33Technology