Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
Austin, TX, United States
Posted
20 hours ago
Machine LearningNLPPython
Job Description
Note: There are 2 Locations. Austin, TX or Sunnyvale, CA (Hybrid)
Required Qualifications:
- 5+ years of software engineering experience with Python or similar programming languages
- Hands-on experience with LLMs and prompt engineering
- Strong understanding of AI evaluation methodologies and quality metrics
- Excellent written and verbal communication skills
- Experience with version control, CI/CD, and modern software development practices
- Ability to manage multiple projects in a fast-paced environment
Key Responsibilities:
- Design, test, and optimize prompts for AI-powered products
- Build and maintain evaluation frameworks to measure model quality and consistency
- Collaborate with product, research, and safety teams to support feature development and model releases
- Develop tools and infrastructure to improve prompt development and testing workflows
- Mentor engineers on prompt engineering best practices
- Support rapid experimentation and continuous improvement of AI systems
Preferred Qualifications:
- Experience with Claude or other frontier AI models
- Background in Machine Learning, NLP, or related fields
- Experience with A/B testing and experimentation frameworks
- Familiarity with AI safety and alignment concepts
- Experience building tools and infrastructure for AI/ML workflows
Similar jobs
- AC
Advanced AI Architect
NewAccenture
Morristown, New Jersey🇺🇸$94.4k - $293.8k/yrOn-site21 minutes agoGenerative AITechnology - JM
AI Engineer - Sr Lead Software Engineer
NewJ.P. Morgan
Wilmington, Delaware🇺🇸On-site21 minutes agoMicroservicesAWSMLOps+6Technology - AC
AI Engineer - Forward Deployed Engineer Associate Manager Databricks Reinvention Centers
NewAccenture
Dallas, Texas🇺🇸$73.8k - $261.5k/yrHybrid22 minutes agoGCPAWSMLOps+11Technology - AC
Forward Deployed AI Engineer
NewAccenture
Chicago, Illinois🇺🇸$132.5k - $366.3k/yrOn-site22 minutes agoJavaJavaScriptPython+1Technology - PE
AI Engineer
NewPercient Inc.
Plano, TX🇺🇸Hybrid20 hours agoExpressFastAPIFlask+8Technology - KA
AI Platform Architect
NewKasmo Inc.
Concord, CA🇺🇸On-site20 hours agoAWSMLOpsAzure+2