Why This Role Stands Out
This remote contract role offers a unique opportunity to shape the future of AI by leveraging your legal expertise in model evaluation, with a focus on critical skills like statutory interpretation and rubric authoring. You'll thrive here if you possess strong legal research and analytical abilities and are eager to contribute to innovative AI development. Apply today to make a significant impact in this exciting field.
Quick Overview
Job Description
Hello,
I hope you're doing well.
I’m Abhay from Inceptra solutions llc, I’m reaching out regarding an immediate requirement for Legal Domain Experts (SMEs) | AI Model Evaluation.
Role: Legal Domain Experts (SMEs) | AI Model Evaluation
Type: Remote Contract role
Location: United States
Interview Process: Resume & Credential Verification → AI-Based Technical Legal Interview → Rubric Authoring & Calibration
Top Skills: Legal Research, Statutory Interpretation, Legal Drafting, Citation Verification, Factuality Assessment, Jurisdictional Analysis, Legal-Authority Hierarchy, Rubric Authoring
Role Purpose
The engagement requires qualified legal domain experts to support human-in-the-loop evaluation of advanced AI systems across complex legal research, statutory interpretation, legal drafting, citation verification, and factuality assessment. Selected experts will establish ground-truth data, create objective evaluation rubrics, assess research trajectories, and identify legal reasoning failure modes.
Phase 1 Priority Hiring Tracks
- Corporate Law — United States (Federal & State): Entity governance, corporate formation, commercial disputes, fiduciary duty, transactional drafting
- Securities Law — United States (Federal): FINRA compliance, Rule 3270, Forms U4/U5, BrokerCheck, SEC enforcement
- Employment & Labor Law — United States (State/Federal): FMLA, FLSA, wage and hour, licensing/bar discipline, restrictive covenants
Mandatory Candidate Profile
- Licensed attorneys: actively licensed or formerly practicing, with 3+ years of relevant experience in the target specialty.
- JD / LL.M. graduates: strong academic credentials plus specialized legal research and writing experience.
- Senior legal research specialists or paralegals: 3+ years of statutory analysis, case-law research, and complex drafting experience.
- Credentials must be verifiable, including law degree, bar admission or relevant certified legal-specialist credentials.
Core Competencies to Validate
- Authority hierarchy
- Jurisdictional analysis
- Citation verification
- Rubric authoring
- Legal drafting
Engagement Model
- Engagement type: Ongoing / recurring pipeline following an initial calibration pilot.
- Staffing approach: Flexible expert pool that can scale with task volume and turnaround requirements.
- Task complexity: High; each evaluation task is estimated to require 10 to 15 hours of expert effort.
- Pilot volume: 5 core calibration tasks in Phase 1, followed by ongoing weekly allocations.
- Collaboration: Direct feedback loops with the client AI Model Factuality research leads.
Candidate Evaluation Process
Stage 1 — Resume & Credential Verification: Confirm law degree, active/past bar admission or specialist credentials, target-jurisdiction expertise, and 3+ years of relevant practice/research experience.
Stage 2 — AI-Based Technical Legal Interview: Assess jurisdiction dissection, legal-authority hierarchy, citation accuracy, unsupported claims, and factual errors.
Stage 3 — Rubric Authoring & Calibration: Candidate creates a sample evaluation rubric with pass/fail criteria, factual-precision checks, and legal reasoning failure categories.
Please share your updated resume and a good time for a quick conversation.
Looking forward to your response.
Similar jobs
- WA
Legal / compliance Evaluator
NewWeekday AI
United States🇺🇸Remote19 hours agoComplianceGoogle WorkspaceMicrosoft OfficeLegal - UP
Estate Planning Attorney, Great Additional Income, Qualified Candidates, No Cost
NewUnited Placement Group
Knoxville, Tennessee🇺🇸HybridYesterdayLegal - UP
Estate Planning Attorney, Great Additional Income, Qualified Candidates, No Cost
NewUnited Placement Group
Morgantown, West Virginia🇺🇸HybridYesterdayLegal - UP
Estate Planning Attorney, Great Additional Income, Qualified Candidates, No cost
NewUnited Placement Group
Tidewater, Virginia🇺🇸HybridYesterdayLegal - UP
Estate Planning Attorney, Great Additional Income, Qualified Candidates, No cost
NewUnited Placement Group
Norfolk, Virginia🇺🇸HybridYesterdayLegal - UP
Estate Planning Attorney, Great Additional Income, Qualified Candidates, No cost
NewUnited Placement Group
Virginia Beach, Virginia🇺🇸HybridYesterdayLegal