Why This Role Stands Out
This remote opportunity offers exciting potential to shape the future of AI evaluation by lending your expertise to leading research organizations, with a competitive hourly rate of $100-$150. You'll thrive here if you possess strong data science skills and a meticulous approach to assessing complex technical work, with ample room for continued professional development.
Quick Overview
Job Description
This role is for one of our clients
Compensation: $100-$150 per hour
We are building a network of experienced data scientists for potential future projects with leading AI research organizations. These projects may focus on evaluating how effectively AI systems perform real-world data science work.
There is no immediate project opening, but qualified applicants may be contacted as relevant opportunities become available.
Potential Responsibilities
Future projects may involve:
- Designing precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, experimentation and A/B test write-ups, feature engineering, and technical reports or notebooks
- Evaluating AI-generated or human-created work against established criteria
- Providing detailed written justifications for evaluations and scores
- Applying consistent, evidence-based judgment so that assessments are reproducible and defensible
- Incorporating structured feedback from senior reviewers and iterating on submitted work
Specific responsibilities will vary depending on the project.
Ideal Qualifications
- 1+ years of professional data science experience
- Experience at a leading technology, research, or quantitative firm (such as top FAANG, AI labs, top-tier quant funds, or equivalent)
- Strong command of Python, SQL, statistical modeling, machine learning, experimentation and causal inference, and translating messy real-world data into rigorous analyses
- Exceptional written communication skills, including the ability to convey technical findings clearly
- A detail-oriented and consistent approach to evaluating complex work
- Comfort receiving feedback and calibrating judgment against established standards
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.