Quality Assurance Specialist Job at Mercor, San Francisco, CA

YzJuUkxkc2l6bVRVWXg4YkZjUFU2VVZGSHc9PQ==
  • Mercor
  • San Francisco, CA

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey .

Position: Quality Control Lead

Type: W2 Employment

Compensation: $80$105/hour

Location: Remote

Commitment: 40 hours/week

Role Responsibilities

  • Audit and evaluate detailed personas digital environments and tasks created by AI Training Scenario Designers. Ensure they are logically sound and properly structured.
  • Apply strict rubrics to score scenarios objectively. Ensure tasks challenge an AI agents ability to reason filter and prioritize.
  • Identify logical inconsistencies factual errors missing context and technical flaws such as invalid JSON structures.
  • Provide clear constructive and actionable feedback to scenario designers to refine their worlds and improve output.
  • Document outcomes by logging review results scores and feedback in Airtable and Crucible .

Qualifications

Must-Have

  • Undergrad degree
  • 2 years professional experience

Preferred

  • Editing / QA background Senior editor QA tester technical reviewer compliance auditor or peer-reviewer.
  • Technical / data comfort JSON familiarity Jira/Asana power user data analyst SQL/Python exposure.
  • Process & Systems thinking Operations managers technical PMs or systems designers.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Job Tags

Full time, Summer work

Similar Jobs

Disney Entertainment Television

Executive Assistant, Casting (Disney Entertainment Television) Job at Disney Entertainment Television

 ...Job Summary: Disney Entertainment Television is seeking a highly skilled and experienced Executive Assistant to support the Head of Casting. This role is ideal for a proactive, detail-oriented, and resourceful individual who thrives in a fast-paced, creative environment... 

The Forehand Agency

Remote Sales Agent — Flexible Scheduling Job at The Forehand Agency

 ...The Forehand Agency is hiring a Remote Sales Agent to identify customer needs, recommend appropriate solutions, and support...  ...diagnose needs, perform needs assessments, and recommend tailored life and health insurance solutions aligned with customer goals. Use CRM systems... 

MRINetwork Jobs

Director of Quality and Risk Management Job at MRINetwork Jobs

 ...Director of Quality and Risk Management Modesto, CA ABOUT THE COMPANY: This acute care hospital is a respected healthcare provider serving the Modesto, California community. The organization is dedicated to delivering safe, high-quality, patient-centered care... 

Carle Health

Patient Sitter - Emergency Department (1p-1:30a) Job at Carle Health

Overview:Under the direction of a Registered Nurse (RN) the Patient Sitter provides a high level of customer service and support to Carle patients by assuring patient safety at bedside and by distributing supplies throughout the department when there are no sitter needs... 

BJC Healthcare

Specialty Pharmacist Job at BJC Healthcare

 ...Information About the Role Are you a licensed pharmacist looking for a new adventure? We are...  ...health and wellness, workplace health, home health, community mental health,...  ...volunteers ensuring the accuracy of their work in accordance with departmental procedures...