Quick overview
Job description
RESPONSIBILITIES
A client with Kforce is seeking an Information Designer II to join the AI Evaluations team in Mountain View, CA. As a conversation designer you would build golden datasets, analyse AI answers at scale and provide insights on quality and accuracy.
Key Responsibilities
- Identify and prioritize opportunities to improve customer experiences and drive business goals in conversational products like chatbots and voice assistants
- Develop end-to-end conversation principles, design strategy, playbooks etc and get alignment from stakeholders like engineering and data science
- Build AI skills (Claude Code or similar) for generating golden datasets for AI evaluations
- Perform offline and online AI answer evaluations at scale with LLM-as-a-judge models and human-in-the-loop
- Drive multiple projects with adherence to deadlines, quality and business metrics
- Bachelor's degree; Education or certifications in Interaction Design, HCI, Psychology, Computer Science, Prompt engineering or related field preferred
- 8 years of design experience, with at least 4 years of conversation design experience and 1year working on AI agentic platforms
- Expertise in data analysis, prompt engineering and AI tools to efficiently deliver artefacts like golden datasets, trends in user responses etc
- Knowledge of language modeling and machine learning frameworks (such as NLUs, RAG databases, TensorFlow, PyTorch, or similar).
- Working understanding of code (html, python, xml, regex) in order to create dynamic dialog-flows using Boolean logic and decision frameworks
- Exceptional communication skills, both written and verbal
- Strong leadership skills, with a proven track record of managing stakeholders, mentoring team members and developing talent
- Experience in conducting user research and usability testing, experiment design and data analysis
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law. This job is not eligible for bonuses, incentives or commissions. Kforce is an Equal Opportunity/Affirmative Action Employer.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status. By clicking ?Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages.
You will always have the right to cease communicating via text by using key words such as STOP.
Similar jobs
- HG

Product Engineer Body Structures (BIW)Recently posted
HTC Global Services · Louisville, KY · On-site · Posted 13 Nov 2026 🇺🇸
AssemblyCATIARoot Cause AnalysisSalary not listed - BT
Transformation Director -Medicaid Platform ModernizationRecently posted
Braintree Technology Solutions · United States · On-site · Posted 14 Nov 2026 🇺🇸
Stakeholder ManagementComplianceCustomer Success+8Salary not listed - OT

Payments Vertical Head (P&L)Recently posted
Openmind Technologies · United States · Remote · Posted 14 Nov 2026 🇺🇸
OnboardingForecastingPipeline ManagementSalary not listed - EG

Art Director - LeadRecently posted
Eliassen Group · McLean, VA · On-site · Posted 13 Nov 2026 🇺🇸
Agile$35 - $42/hr - AS
JDA/BY Allocation ConsultantRecently posted
Aspire Systems Digital Transformation Inc · Dublin, CA · Hybrid · Posted 14 Nov 2026 🇺🇸
OraclePL/SQLSQL+2$75 - $85/hr - VO
Research Associate- Analytical ChemistryRecently posted
Volt · Boulder, CO · Hybrid · Posted 14 Nov 2026 🇺🇸
Compliance$30 - $34/hr - ID

IT Knowledge Management AnalystRecently posted
IDR, Inc. · Memphis, TN · Hybrid · Posted 14 Nov 2026 🇺🇸
Microsoft OfficeConfluenceSharePointSalary not listed - DT

The Blueprint Administrator (Specialist III)Recently posted
Donato Technologies Inc · Albany, NY · Hybrid · Posted 13 Nov 2026 🇺🇸
Technical SupportAzureJira+1Salary not listed - LE

Government Services Chief Technology OfficerRecently posted
Leidos · Cabin John, Maryland · Hybrid · Posted 14 Nov 2026 🇺🇸
Market ResearchRequirements GatheringBusiness DevelopmentSalary not listed - CD
Office Management Staff Office SupportRecently posted
Connexions Data Inc · Denver, CO · Hybrid · Posted 13 Nov 2026 🇺🇸
Office ManagementStrategic PlanningSharePointSalary not listed - IT

Oracle Fusion ConsultantRecently posted
Iresh Technologies · Atlanta, Georgia · Remote · Posted 14 Nov 2026 🇺🇸
OraclePL/SQLSQL+5Salary not listed - DI

Structural Processing Lead (Weekend Shift)Recently posted
Dogwood Industries LLC · Sedro Woolley, Washington · On-site · Posted 14 Nov 2026 🇺🇸
WorkdayMicrosoft ExcelMicrosoft Office+1$38 - $45/hr
