Legal Expert – Remote Contract (LLM Benchmarking)

About the role

We are seeking a seasoned attorney to join our team on a remote contract basis. The role focuses on creating and evaluating complex, multi‑step benchmark tasks that use real‑world legal documents to test large language models (LLMs) for document understanding and instruction following.

Key responsibilities

• Design and author multi‑step tasks using authentic legal materials such as contracts, briefs, regulatory filings, and case memos.
• Define clear ground‑truth outputs and objective evaluation rubrics for each benchmark.
• Assess model performance on legal language interpretation, multi‑step instruction compliance, and structured reasoning.
• Apply deep domain knowledge across one or more legal sub‑domains to ensure tasks reflect professional complexity.

Required profile

• Strong experience in corporate & commercial law, litigation, intellectual property, regulatory & compliance, or employment & labor law.
• Proven track record authoring structured legal documents and handling complex, multi‑part instructions.
• Experience evaluating or quality‑assuring legal analysis in a professional or research setting.

Required skills

What we offer

• Competitive hourly rate ranging from $70 to $90.
• Flexible commitment of 15–20 hours per week.
• Fully remote work environment.