Role Overview
Mercor is hiring a mid-level Professional Evaluator - Fully Remote. This is a contract role in CA. Full responsibilities, required qualifications, and the apply link are listed in the description below.
Resume Keywords to Include
Make sure these keywords appear in your resume to improve ATS scoring
Sign up free to auto-tailor your resume with all these keywords and get a higher ATS score
Job Description
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: AI Model Evaluation Specialist
Type: Contract
Compensation: $60–$80/hour
Commitment: 20 hours/week
Role Responsibilities
- Write realistic prompts reflecting professional and consumer domain-specific guidance.
- Evaluate AI-generated responses for factual accuracy, regulatory correctness, and practical usefulness.
- Identify fabricated claims, incorrect references, or misleading reasoning in model outputs.
- Score and rank model responses using structured rubrics across dimensions.
- Provide written justifications with specific evidence for each evaluation.
Qualifications
Must-Have
- Master’s degree or higher in Finance, Accounting, Law, Medicine, Healthcare, or Engineering.
- Professional experience applying domain expertise in a practitioner or advisory capacity.
- Familiarity with industry-specific standards, regulations, or clinical guidelines.
- Strong written communication and critical reasoning skills.
Application Process (Takes 20–30 mins to complete)
- Submit your resume to begin.
- Complete a Training Assessment.
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
,
Frequently Asked Questions
How do I apply for the Professional Evaluator - Fully Remote position at Mercor?
Use the Apply button above to submit your application directly to Mercor. Most applications take less than 5 minutes if your resume and contact details are ready, and you'll be routed to the employer's official application system to finish.
Where is the Professional Evaluator - Fully Remote position at Mercor located?
This position is based in CA. Mercor has not indicated remote or hybrid options for this role, so candidates should plan for on-site work.
What does a Professional Evaluator - Fully Remote at Mercor earn?
Mercor has not disclosed a salary range in this posting. Many employers share specifics later in the interview process; you can also ask during a recruiter screen if compensation transparency is important to you.
When was the Professional Evaluator - Fully Remote role at Mercor posted?
This role was posted on March 20, 2026 (80 days ago). It's still listed as actively hiring; we re-confirm openings against the source system multiple times per day and remove closed roles.
AI-powered job search
Get every job scored to your resume
Upload your resume and get jobs ranked, your resume tailored, and employee contacts found automatically.
Get Started FreeNo credit card to start