Why this role stands out
This remote role offers flexible hours and the chance to significantly contribute to the development of trusted AI systems for a reputable global data engineering company. You'll thrive here if you have a keen eye for detail and experience in customer service, leveraging your bilingual skills to evaluate AI responses and ensure high-quality outcomes. Apply today to grow your expertise in the exciting field of AI!
Quick overview
Job description
Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.
Role Overview
We are seeking detail-oriented evaluators to conduct human quality evaluations for an enterprise AI customer support product on Instagram, WhatsApp, and Messenger. You will evaluate and benchmark AI model responses against complex evaluation rubrics using provided business knowledge bases.
What You’ll Own:
- Model Evaluation: Review and score AI-generated customer interactions across Foundational, Experiential, and Operational dimensions (e.g., Action Fidelity, Faithfulness, Hallucination, Compliance, Tone, and Handoff).
- Intent & Fact Verification: Benchmark both informational (R1) and transactional (R2) customer queries against authoritative business sources (FAQs, product catalogs, SOPs) within the task UI.
- Quality Assurance: Participate in dual-review processes and daily calibration audits to ensure inter-rater agreement and establish ground-truth performance targets.
- Performance Targets: Deliver precise evaluation
You’ll Thrive in This Role If You Have:
- Customer Service Background: Prior experience in customer service, call centers, retail, or handling customer communications via email, chat, or phone (highly prioritized).
- English Proficiency: Exceptional written English skills with a strong command of tone, brand voice, grammar, and nuance.
- Vietnamese Proficiency: Exceptional written Vietnamese skills with a strong command of tone, brand voice, grammar, and nuance.
- Analytical Precision: Ability to strictly follow multi-tier evaluation guidelines, complex logic trees, and technical rubrics without deviation.
- Tech Adaptability: Comfort using dedicated web-based tools and labeling interfaces.
The expected hourly salary range for this position is up to $20 p/hour, based on experience, skills, and qualifications.
Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams.
If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at verifyjoboffer@innodata.com and consider reporting it to the FTC at ReportFraud.ftc.gov.
Similar jobs
- OS
General ApplicationNew Auto Apply
Osmo · Elizabeth · On-site 🇺🇸
Talent AcquisitionSalary not listed2 hours ago - DI

Client DirectorNew Auto Apply
Diaceutics · Parsippany-Troy Hills · Hybrid 🇺🇸
CRMCustomer SuccessForecasting+7Salary not listed5 hours ago - OS

Sr. Director of Agents GrowthNew Auto Apply
Oscilar · Remote · Remote 🇺🇸
OnboardingApacheCompliance+9Salary not listed9 hours ago - GA

Analyst, Portfolio ManagementNew Auto Apply
General Atlantic · New York - Park Avenue · Hybrid 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft PowerPoint+4Salary not listed3 hours ago - GS

Senior Account CoordinatorNew Auto Apply
Game Seven · New York · Hybrid 🇺🇸
Microsoft ExcelNotionGenerative AI+2Salary not listed38 minutes ago - FA
Agent Apprentice - Farmers InsuranceNew Auto Apply
Farmersd40 · Thomas Pastor - North Muskegon · On-site 🇺🇸
CRMComplianceProspecting+1Salary not listed32 minutes ago - FA
Agent in Training - Farmers InsuranceNew Auto Apply
Farmersd40 · Stephen Knight Agency - Belding · On-site 🇺🇸
OnboardingCross-sellingLead Generation+2Salary not listed1 hour ago - EB
Facilities DirectorNew Auto Apply
Emigrant Bank · New York · Hybrid 🇺🇸
BudgetingComplianceContinuous Improvement+4Salary not listed2 hours ago - DA

Head of RiskNew Auto Apply
Deeter Analytics · US - Remote · Remote 🇺🇸
SQLDerivativesPython+1Salary not listed4 hours ago - CI
Navy Planning SMENew Auto Apply
C5MI Insight · Remote - United States · Remote 🇺🇸
ArticulateERPContinuous Improvement+4Salary not listed2 hours ago - LO
Mechanical Technician - Full Time InternshipNew Auto Apply
LotusWorks · Chandler · Hybrid 🇺🇸
AssemblyHVACSalary not listed1 hour ago - MI

Liability Claims SpecialistNew Auto Apply
Michels Corporation · Lakeville · Hybrid 🇺🇸
Microsoft OfficeHeavy EquipmentRisk ManagementSalary not listed2 hours ago
