AI Evaluation Engineer - Software

Full Timemid

CAPosted 2 days ago

Role Overview

Mercor is hiring a mid-level AI Evaluation Engineer - Software. This is a full-time role in CA. posted 2 days ago. Full responsibilities, required qualifications, and the apply link are listed in the description below.

Resume Keywords to Include

Make sure these keywords appear in your resume to improve ATS scoring

PythonJavaScriptTypeScriptGoKubernetesGitGitHubDevOps

Job description

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Senior Software Engineers

Type: Contract

Compensation: $50–$75/hour

Location: US/ Canada

Duration: 1 week

Commitment: 10+ hours/week

Role Responsibilities

Evaluate AI-generated code for correctness, quality, maintainability, and engineering best practices.
Review code changes, technical discussions, and related software artifacts.
Provide structured evaluations with clear technical reasoning.
Collaborate with fellow technical reviewers to ensure high-quality and consistent evaluations.
Become familiar with assigned open-source codebases and their engineering practices.

Qualifications

Must-Have

3+ years of professional software engineering experience.
Proficiency in JavaScript / TypeScript and Go.
Experience with Python for backend development and DevOps.
Strong understanding of Git and GitHub workflows.
Strong English communication skills.

Preferred

Familiarity with Kubernetes and open-source development workflows.
Experience with SWE-Bench or SWE-Bench Pro.

Start Date

July 8–14

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

About Mercor

Mercor

mercor.com

On-site

55 other open roles at Mercor on TryApplyNow.

View all 56 roles at Mercor Visit website

Frequently Asked Questions

How do I apply for the AI Evaluation Engineer - Software position at Mercor?

Use the Apply button above to submit your application directly to Mercor. Most applications take less than 5 minutes if your resume and contact details are ready, and you'll be routed to the employer's official application system to finish.

Where is the AI Evaluation Engineer - Software position at Mercor located?

This position is based in CA. Mercor has not indicated remote or hybrid options for this role, so candidates should plan for on-site work.

What does a AI Evaluation Engineer - Software at Mercor earn?

Mercor has not disclosed a salary range in this posting. Many employers share specifics later in the interview process; you can also ask during a recruiter screen if compensation transparency is important to you.

When was the AI Evaluation Engineer - Software role at Mercor posted?

This role was posted on July 5, 2026 (2 days ago). It's still listed as actively hiring; we re-confirm openings against the source system multiple times per day and remove closed roles.