AI Planning QA Reviewer - PhD

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Automated CS Planning QA Reviewers — Zion (Arches)
Type: Contract
Compensation: $55–$80/hour
Location: Remote

Role Responsibilities

• Review and quality-check challenging symbolic-AI and automated-planning problems authored by domain experts.
• Verify correctness, technical rigor, and clarity of data used to train and evaluate state-of-the-art large language models.
• Conduct multiple independent reviews for each problem to ensure accuracy and depth.
• Collaborate with domain experts to maintain high standards in problem-solving and model evaluation.
• Work independently and asynchronously to meet deadlines and improve AI model performance.

Qualifications

Must-Have

• PhD or advanced degree in Computer Science, Artificial Intelligence, Machine Learning, or Operations Research.
• Strong reviewing / QA instincts to verify problem correctness and solutions.
• High attention to detail.
• Exceptional written and verbal communication skills.

Start Date

• Applications reviewed on a rolling basis.

Interview Process

• Complete a short interview and task (20–30 mins).
• Paid for up to 1 hour of onboarding time, including onboarding videos if hired.

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: [email protected]

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.