Quick Overview
Job Description
Project Overview
We are sourcing independent Finance and Insurance Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly generate professional-grade financial and insurance deliverables, their accuracy relies entirely on robust, expert-crafted training data. The objective of this project is to autonomously produce high-quality evaluation tasks, strong prompts, and clear, well-structured rubrics that generate clean, reliable data for model training.
Project Deliverables & Scope
Operate autonomously to design complex evaluation frameworks and provide structured training data. Expected deliverables include:
- Task & Prompt Creation: Generating realistic, high-quality prompts that compel the AI model to produce complex, professional-grade deliverables specific to the finance and insurance sectors.
- Rubric Development: Writing clear, well-structured evaluation rubrics with criteria that are highly specific, non-ambiguous, and easy to score.
- Benchmark Evaluation Data Generation: Producing clean, reliable training data that directly aids in the evaluation and refinement of AI models handling industry-specific tasks.
- Quality Assurance & Fact-Checking: Ensuring all generated tasks and scoring criteria reflect strict, real-world industry standards and regulatory realities.
Required Expertise
To successfully fulfill the deliverables of this project, Contractors must possess deep industry knowledge to craft realistic professional scenarios.
Core skillset includes:
- Demonstrable professional expertise within the Finance and Insurance sectors, with a deep understanding of industry standards, terminology, and high-level deliverables.
- Strong writing and prompt generation skills, with the ability to design highly realistic, complex task scenarios for AI evaluation.
- Proficiency in rubric generation, specifically the ability to create objective, non-ambiguous scoring criteria that leave no room for subjective interpretation.
- A meticulous, detail-oriented approach to generating clean, reliable data for system benchmarking.
We offer a pay range of $10-$30 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Engagement Type: Freelance / Independent Contractor
Workplace Type: Remote
Similar jobs
- PA
Swim Instructor
NewPremier Aquatics
Aliso Viejo, California🇺🇸On-site14 hours agoEducation - BL
Cyber Technical Instructor with Security Clearance
By Light Professional IT Services
Hanover, MD🇺🇸$110k - $150k/yrOn-site6 weeks agoTCP/IPActive DirectoryAnsible+5Technology - WW
Studio Coach - Lawrence, KS
NewWeight Watchers
United States - Studios🇺🇸YesterdayGreenhouseHTTPSOnboarding+1 - SP
Safety Trainer, X Money
SpaceXAI
Bastrop🇺🇸5 days agoSQLLookerTableau+13 - WW
Studio Coach - Moorhead, MN
Weight Watchers
United States - Studios🇺🇸1 week agoGreenhouseHTTPSOnboarding+1 - WW
Studio Coach - Missoula, MT
Weight Watchers
United States - Studios🇺🇸$18 - $21/hr1 week agoGreenhouseHTTPSOnboarding+1