Haystack
← Back to Jobs
Remote
Temporary/Casual
Other
WA

Applied History & Political Science Benchmark Specialist

Weekday AIUnited StatesπŸ‡ΊπŸ‡ΈUnited StatesPosted Sep 16, 2026

Why This Role Stands Out

Leverage your expertise in history and political science to contribute to cutting-edge AI research by authoring and verifying academic assessment content. This remote, mid-senior role offers excellent hourly compensation and the chance to develop valuable skills while shaping the future of AI benchmarks. If you possess a deep understanding of national security, public policy, or environmental history, you'll thrive in this intellectually stimulating opportunity.

Quick Overview

Salary
$44 - $56/hr
Seniority
Mid Senior
Employment type
Temporary/Casual
Work mode
Remote
Location
United States
Posted
3 weeks ago
Express

Job Description

This role is for one of our clients

Compensation: $44 - $56 per hour

We are seeking experts in history and political science to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core history and political science domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types:

  • Question AuthoringΒ β€” Create original, challenging multiple-choice questions in your area of expertise, rate their difficulty, and submit them for review.
  • Question VerificationΒ β€” Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made.

History & Political Science Domains Covered

National Security, Public Policy, Business History, Environmental History, Latin American History.

Key Responsibilities

  • Author original history and political science questions that test deep conceptual understanding, not surface-level recall
  • Ensure questions are unambiguous, self-contained, and precisely defined β€” all necessary information must be in the problem statement
  • Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above)
  • Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers
  • Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format
  • Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, university repositories)
  • For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made

Ideal Qualifications

  • PhD or doctoral candidate in History, Political Science, International Relations, or a closely related field
  • Master's degree considered for candidates with exceptional depth in a specific subdomain
  • Strong command of historiographical methods, political theory, and comparative analysis
  • Research publications or policy experience is a strong plus
  • Excellent written English and ability to express complex ideas clearly and concisely

More About the Opportunity

  • Expected commitment: 10+ hours/week
  • Asynchronous, fully remote work

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.