Why this role stands out
This Special Project Lead role offers a unique opportunity to shape the future of AI for creatives, bridging the gap between clients, creative experts, and engineering teams to deliver impactful research. You'll thrive here if you excel at project management, cross-functional communication, and driving rigorous, user-centered outcomes in a dynamic, innovative environment. Apply to make a significant contribution to cutting-edge AI development!
Quick overview
Job description
Who we are
Contra Labs is a human-centered research lab studying how creatives actually use AI, how tools can serve creative work better, and how to protect the originality that gets flattened as everything starts to look the same.
We connect a global network of top creative talent with frontier AI labs and product companies. By grounding our research in real creative workflows, we help define what "good" looks like across design, video, imagery, and beyond. Our work powers benchmarking, evaluation, and post-training for leading models and applications. Built on Contra, the professional network for independent creatives, we turn human judgment into the training and evaluation layer that helps these tools serve the people who use them.
Why this role exists
We are scaling across client engagements: post-training dataset creation, benchmarking programs, and ongoing evaluation partnerships. Each project spans a different mix of AI labs, creative-tool companies, and research teams, with different requirements, timelines, and quality bars. We need someone to own this work from end to end.
Think of yourself as the operator for a project or vertical. You sit between three groups that do not naturally talk to each other: the client who needs the data, the creative experts producing it, and the internal engineering team building the tooling. Your job is to make all three feel like they are working on the same thing, and to ship results that are both rigorous and genuinely useful.
What you'll own
The methodology. Annotation protocols, rubrics, and evaluation designs for creative and multimodal outputs.
Delivery. Scope, evaluator staffing, quality routing, timelines, and the client relationship, from kickoff to final readout.
Quality. Data quality, inter-rater reliability, and real-time course correction when something feels off. You hold the bar, and you hold the levers to fix it.
Analysis and storytelling. Qualitative and quantitative analysis turned into clear findings, recommendations, reports, and workshops that clients act on.
The systems behind it. You turn repeated work into clean, measurable process, and you partner with engineering on the tooling that makes that process faster and more reliable.
The narrative. Case studies and benchmark publications that sharpen how Contra Labs is understood in the market.
About you
You design studies for a living. You can scope a question, run the study, analyze the data, and translate it into a direction people can act on.
You understand good creative, and you can explain it. You recognize creative quality and can say why, and you can tell the difference between personal preference and something closer to ground truth. You build frameworks that capture that signal faithfully.
You care more about people than about technology for its own sake. You understand how humans judge creative work and design systems around that.
You turn messy work into machines. You make process clear, predictable, and measurable, and you run a tight ship across several projects at once.
High ownership, low ego, bias to action. You ship a v1, learn, and do what it takes to deliver.
Experience
3+ years designing studies, running evaluations, analyzing data, and presenting findings.
Experience with data labeling, annotation, human-in-the-loop systems, or AI and ML evaluation workflows.
A track record managing several concurrent projects, including annotation, evaluation, or QA work.
A real point of view on creative quality and what "good" looks like.
Bonus
A strong research background, qualitative and quantitative. A Master's or PhD in HCI, cognitive science, psychology, design research, or a related field is a plus, and so is equivalent depth from industry.
Statistical methods for evaluation work: inter-rater reliability, sampling, regression, significance testing.
RLHF, LLM evaluation, or benchmark design.
Ethnography, UX research, or design-study methods.
Startup or 0-to-1 experience.
Requirements
Based in NYC. In office 5 days a week (Williamsburg).
Total comp
Salary: $150,000 to $200,000 USD plus equity
Medical, dental, vision
401k matching
Company laptop on your start date
Interview process
Recruiting team (20 minutes)
CEO and co-founder (30 minutes)
Technical interview, research and methods focus (45 minutes)
VP of Product (45 minutes)
Paid case study and presentation (60 minutes)
Note: Contra communicates with applicants through contra.com domains only. We never ask candidates for money. For current postings, visit Contra Careers.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- ML

Senior Director, Platform Prioritization & DeliveryRecently posted Auto Apply
Mission Lane · Remote · Remote · Posted 19 Nov 2026 🇺🇸
JiraAsanaMonday.comLogistics$196k - $243k/yr - AI

Special Projects LeadRecently posted Auto Apply
Adaptive Innovations · New York · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLMicrosoft ExcelArticulate+6Salary not listed - VE

Manufacturing Project Manager Auto Apply
Velo3d · Fremont · On-site · Posted 10 Nov 2026 🇺🇸
Stakeholder ManagementProject ManagementOperations & Project Management$90k - $120k/yr - VA

Technical Project Manager II Auto Apply
Vailsys · Greater Chicago Area · Hybrid 🇺🇸
ScrumPMPJira+3Operations & Project Management$105k - $120k/yr - AL

Designer & Project ManagerRecently posted Auto Apply
Allora · Athens, Georgia · On-site · Posted 18 Nov 2026 🇺🇸
ProcurementProject ManagementOperations & Project ManagementSalary not listed - ED
Senior Clinical Project Manager Auto Apply
EDETEK · United States · Remote 🇺🇸
Microsoft OfficeProject ManagementOperations & Project ManagementSalary not listed - KS
Sr. Project Manager (Industrial Operations)Recently posted Auto Apply
KPI Solutions · Kansas City, Missouri · Remote · Posted 18 Nov 2026 🇺🇸
Stakeholder ManagementMicrosoft OfficePMP+3Operations & Project ManagementSalary not listed - OC
Construction SchedulerRecently posted Auto Apply
Overwatch Construction Management · Anaheim, California · Hybrid · Posted 18 Nov 2026 🇺🇸
Construction ManagementSalary not listed - LO

Senior Data Center Project ManagerRecently posted Auto Apply
Loenbro · Westminster · Hybrid · Posted 18 Nov 2026 🇺🇸
FiberProject ManagementNetwork AdministrationTechnology$140k - $180k/yr - LO

Assistant Project ManagerRecently posted Auto Apply
Loenbro · Aurora · Hybrid · Posted 18 Nov 2026 🇺🇸
Microsoft OfficeProject ManagementAdministrative$100k - $135k/yr - FA

Senior Programs & Strategy Manager Auto Apply
Far.ai · Remote (US) · Remote 🇺🇸
SourcingStakeholder ManagementCRM+4Salary not listed - AN
Project CoordinatorRecently posted Auto Apply
ARCO/Murray National Construction · Milwaukee · Hybrid · Posted 17 Nov 2026 🇺🇸
Microsoft ExcelMicrosoft WordProject ManagementOperations & Project Management$28k/yr
