Why This Role Stands Out
Leverage your expertise in UK law to contribute to a groundbreaking AI benchmarking initiative, offering significant flexibility with a remote work arrangement and a highly competitive hourly rate of $150-$160. This role is ideal for experienced in-house counsel who are detail-oriented and eager to shape the future of legal technology by evaluating AI's practical application in the UK legal landscape. Apply today to be at the forefront of innovation in legal services.
Quick Overview
Job Description
This role is for one of our clients
Compensation: $150-$160 per hour
We are seeking experienced in-house legal counsel based in the United Kingdom to support a legal AI benchmarking initiative focused on evaluating how effectively AI systems handle real-world questions involving UK law.
As an expert reviewer, you will assess responses generated by two AI platforms, compare their legal reasoning and conclusions, and evaluate each response against a standardized rubric. Your professional expertise will help establish reliable benchmarks for the quality, accuracy, and practical relevance of AI-generated legal work.
Key Responsibilities
- Run identical legal prompts across two AI/LLM platforms.
- Review and compare AI-generated legal responses side by side.
- Evaluate each response against a standardized assessment rubric.
- Assess legal accuracy, reasoning quality, completeness, relevance, and practical applicability.
- Identify material differences, omissions, inconsistencies, and potential legal inaccuracies.
- Provide concise, precise, and well-reasoned written feedback for every evaluation.
- Apply evaluation criteria consistently and objectively across assigned tasks.
- Complete assignments independently while adhering to project guidelines and deadlines.
Requirements
- 5+ years of experience as in-house legal counsel practicing in the United Kingdom.
- Strong command of UK law, particularly commercial and contract matters.
- Practical experience advising businesses and assessing real-world legal and commercial risks.
- Excellent attention to detail and strong analytical judgment.
- Exceptional written English and the ability to communicate complex legal concepts clearly and concisely.
- Ability to distinguish legally accurate analysis from plausible but incorrect or incomplete reasoning.
- Comfortable working independently with structured evaluation rubrics.
- Strong ability to manage deadlines and consistently deliver high-quality assessments.
Engagement Details
- Initial Commitment: Approximately 10 hours
- Potential: Strong possibility of additional work based on project requirements and performance
- Work Arrangement: Fully remote
- Confidentiality: All project work will be subject to applicable confidentiality requirements and NDA obligations.
- Engagement Type: Independent contractor
Equal Employment Opportunity
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms
- This is a fully remote engagement that can be completed on a flexible schedule.
- Projects may be extended, shortened, or concluded early depending on project requirements and performance.
- Work will not require access to confidential or proprietary information belonging to any employer, client, or institution.
- Payments are made weekly based on services rendered through supported payment platforms.