Quick overview
Job description
Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.
- Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
- The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
- The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
- Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
- Each task will include detailed project guidelines within the evaluation platform.
- 3+ years of hands-on experience in LLM / GenAI data evaluation.
- Bachelor's Degree required
- Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
- Comfortable evaluating content across multiple modalities
Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours: Workload may vary weekly
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- UU

Senior Manager, Enterprise Implementation - HawaiiRecently posted Auto Apply
Unite Us · United States · Hybrid · Posted 15 Nov 2026 🇺🇸
OnboardingCustomer SuccessMental Health+4$120k - $145k/yr - ST

Chief ScientistRecently posted Auto Apply
STR · Arlington · Hybrid · Posted 13 Nov 2026 🇺🇸
ComplianceGenerative AIMachine Learning+1$265k - $330k/yr - NA

Clinical Field SpecialistRecently posted Auto Apply
Natera · Lubbock · Hybrid · Posted 14 Nov 2026 🇺🇸
Microsoft ExcelMicrosoft PowerPointCompliance+5$165k - $195k/yr - NA

Manager Quality Assurance and Regulatory AffairsRecently posted Auto Apply
Natera · US Remote · Remote · Posted 13 Nov 2026 🇺🇸
CompliancePharmacyRegulatory Compliance+2$112.1k - $150k/yr - LH

Part Time Floor Leader - American Dream MeadowlandsRecently posted Auto Apply
Lush Handmade Cosmetics · East Rutherford · Hybrid · Posted 15 Nov 2026 🇺🇸
ArticulateDiversity & InclusionReconciliation+1$19/hr - LH

Seasonal Ambassador - American DreamRecently posted Auto Apply
Lush Handmade Cosmetics · East Rutherford · Hybrid · Posted 15 Nov 2026 🇺🇸
ArticulateDiversity & InclusionReconciliation+1$17/hr - LH

Seasonal Ambassador - American DreamRecently posted Auto Apply
Lush Handmade Cosmetics · East Rutherford · Hybrid · Posted 15 Nov 2026 🇺🇸
ArticulateDiversity & InclusionReconciliation+1$17/hr - IJ
Part Time Floor Leader - American Dream MeadowlandsRecently posted Auto Apply
Internal Job Board · East Rutherford · Hybrid · Posted 15 Nov 2026 🇺🇸
ArticulateDiversity & InclusionReconciliation+1$19/hr - HI

Director, SocialRecently posted Auto Apply
Highwire · Colorado · Hybrid · Posted 15 Nov 2026 🇺🇸
Digital MarketingProject Management$110k - $135k/yr - HI

Director, SocialRecently posted Auto Apply
Highwire · California · Hybrid · Posted 15 Nov 2026 🇺🇸
Digital MarketingProject Management$110k - $150k/yr - HI

Director, SocialRecently posted Auto Apply
Highwire · San Francisco · Hybrid · Posted 15 Nov 2026 🇺🇸
Digital MarketingProject Management$110k - $150k/yr - HI

Director, SocialRecently posted Auto Apply
Highwire · New York · Hybrid · Posted 15 Nov 2026 🇺🇸
Digital MarketingProject Management$110k - $150k/yr