This role is for one of our clients
Compensation: $150-$160 per hour
We are seeking experienced in-house legal counsel based in the United Kingdom to support a legal AI benchmarking initiative focused on evaluating how effectively AI systems handle real-world questions involving UK law.
As an expert reviewer, you will assess responses generated by two AI platforms, compare their legal reasoning and conclusions, and evaluate each response against a standardized rubric. Your professional expertise will help establish reliable benchmarks for the quality, accuracy, and practical relevance of AI-generated legal work.
Requirements
Key Responsibilities
- Run identical legal prompts across two AI/LLM platforms.
- Review and compare AI-generated legal responses side by side.
- Evaluate each response against a standardized assessment rubric.
- Assess legal accuracy, reasoning quality, completeness, relevance, and practical applicability.
- Identify material differences, omissions, inconsistencies, and potential legal inaccuracies.
- Provide concise, precise, and well-reasoned written feedback for every evaluation.
- Apply evaluation criteria consistently and objectively across assigned tasks.
- Complete assignments independently while adhering to project guidelines and deadlines.
Requirements
- 5+ years of experience as in-house legal counsel practicing in the United Kingdom.
- Strong command of UK law, particularly commercial and contract matters.
- Practical experience advising businesses and assessing real-world legal and commercial risks.
- Excellent attention to detail and strong analytical judgment.
- Exceptional written English and the ability to communicate complex legal concepts clearly and concisely.
- Ability to distinguish legally accurate analysis from plausible but incorrect or incomplete reasoning.
- Comfortable working independently with structured evaluation rubrics.
- Strong ability to manage deadlines and consistently deliver high-quality assessments.
Engagement Details
- Initial Commitment: Approximately 10 hours
- Potential: Strong possibility of additional work based on project requirements and performance
- Work Arrangement: Fully remote
- Confidentiality: All project work will be subject to applicable confidentiality requirements and NDA obligations.
- Engagement Type: Independent contractor
Equal Employment Opportunity
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms
- This is a fully remote engagement that can be completed on a flexible schedule.
- Projects may be extended, shortened, or concluded early depending on project requirements and performance.
- Work will not require access to confidential or proprietary information belonging to any employer, client, or institution.
- Payments are made weekly based on services rendered through supported payment platforms.