Mercor seeks a Generalist Search Expert to evaluate AI-generated content accuracy and develop evaluation rubrics for leading AI research labs. Contract role, fully remote, $40-70/hr.
Strong research background in any domain
Evaluate accuracy and depth of AI-generated content to strengthen reasoning in model outputs
Review complex content for alignment with domain principles and methodologies
Provide structured feedback to AI research teams to improve training data quality
Develop evaluation rubrics and benchmarks for assessing AI-generated tasks
Collaborate with subject matter experts to ensure consistency across datasets
Work independently and asynchronously to meet deadlines while improving AI model performance
Contract position with compensation of $40-70 per hour
Application process takes 20-30 minutes including resume upload and AI interview
Team reviews applications daily
Company connects elite talent with leading AI research labs
Investors include Benchmark, General Catalyst, Peter Thiel, and others