Skip to main content
PrismCV
How Scoring WorksJobsPricing
LoginCheck Your Resume
Check Your Resume
← Back to all jobs

CS Benchmark Expert - Fully Remote | Upto $84/hr

mercor · Remote (India)

$137k - $175k
Remote
Full-time
Mid

Posted January 21, 1970

Check your resume against this jobApply on Himalayas
AI Summary

Mercor is hiring a remote contract Applied Computer Science Benchmark Specialist to author original, unambiguous CS questions testing deep conceptual understanding. The role involves rating question difficulty, writing one correct answer with nine plausible distractors, producing step-by-step Chain-of-Thought solutions in markdown, and supplying academic references. It also includes verifying other questions for clarity, completeness, precision, and solvability, making it suited to PhD-level experts who want to shape AI evaluation benchmarks.

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Applied Computer Science Benchmark Specialist
Type:Contract
Compensation:$66–$84/hour
Location:Remote
Commitment:10+ hours/week

Role Responsibilities

  • Author original computer science questions that test deep conceptual understanding.
  • Ensure questions are unambiguous, self-contained, and precisely defined.
  • Rate each question's difficulty as Medium, Hard, or Expert.
  • Provide 1 correct answer and 9 plausible but subtly incorrect alternatives.
  • Write step-by-step Chain-of-Thought solutions in markdown format.
  • Supply 1–5 academic references per question from reputable sources.
  • For verification tasks: flag issues with clarity, completeness, precision, or solvability.

Qualifications

Must-Have

  • PhD or doctoral candidate in Computer Science, Electrical Engineering, or a closely related field.
  • Master's degree considered for candidates with exceptional depth in a specific subdomain.
  • Strong command of graduate-level CS theory, algorithms, systems design, and/or machine learning.
  • Excellent written English and ability to express complex ideas clearly and concisely.

Preferred

  • Research publications, industry experience at top tech companies, or competitive programming background.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check:
  • For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Originally posted on Himalayas

More jobs at mercor

See how well your resume matches this job before you apply

Run a free ATS check