Why This Role Stands Out
Leverage your bilingual skills to contribute to the responsible advancement of AI by evaluating AI model responses for a leading data engineering company. This remote, flexible-hour role offers a fantastic opportunity to develop your analytical and critical thinking skills while working with cutting-edge AI technology. You'll thrive here if you have a keen eye for detail and a background in customer service, making this an excellent step in your career.
Quick Overview
Job Description
Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.
Role Overview
We are seeking detail-oriented evaluators to conduct human quality evaluations for an enterprise AI customer support product on Instagram, WhatsApp, and Messenger. You will evaluate and benchmark AI model responses against complex evaluation rubrics using provided business knowledge bases.
What You’ll Own:
- Model Evaluation: Review and score AI-generated customer interactions across Foundational, Experiential, and Operational dimensions (e.g., Action Fidelity, Faithfulness, Hallucination, Compliance, Tone, and Handoff).
- Intent & Fact Verification: Benchmark both informational (R1) and transactional (R2) customer queries against authoritative business sources (FAQs, product catalogs, SOPs) within the task UI.
- Quality Assurance: Participate in dual-review processes and daily calibration audits to ensure inter-rater agreement and establish ground-truth performance targets.
- Performance Targets: Deliver precise evaluation
You’ll Thrive in This Role If You Have:
- Customer Service Background: Prior experience in customer service, call centers, retail, or handling customer communications via email, chat, or phone (highly prioritized).
- English Proficiency: Exceptional written English skills with a strong command of tone, brand voice, grammar, and nuance.
- French Proficiency: Exceptional written French skills with a strong command of tone, brand voice, grammar, and nuance.
- Analytical Precision: Ability to strictly follow multi-tier evaluation guidelines, complex logic trees, and technical rubrics without deviation.
- Tech Adaptability: Comfort using dedicated web-based tools and labeling interfaces.
Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams.
If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at verifyjoboffer@innodata.com and consider reporting it to the FTC at ReportFraud.ftc.gov.
Similar jobs
- ND
Associate Director, Partner Strategy & Solutions
NewNTT DATA
Plano, Texas🇺🇸Hybrid4 minutes agoGCPAWSAzure+1 - PA
Category Manager
NewPatterson
Saint Paul, Minnesota🇺🇸Hybrid4 minutes agoTableauERPForecasting+1 - SW
Bilingual Branch Wholesale Product Specialist
NewSherwin Williams
Rockford, Illinois🇺🇸Hybrid13 minutes ago - AH
Surgical Technologist Outpatient
NewAvera Health
Sioux Falls, SD🇺🇸Hybrid11 hours agoAssemblyInfection ControlNursing+1 - EH
Family Care-Service Coordinator
NewElevance Health
Waukesha, WI🇺🇸Hybrid11 hours agoCare CoordinationProcess Improvement - UG
Senior Manager Data Engineering - Eden Prairie, MN
NewUnitedHealth Group
Minneapolis, MN🇺🇸$112.7k - $193.2k/yrHybrid11 hours ago401kSQLETL+7