STEM Generalist Evaluator
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.
Role Description
Mercor is seeking PhD holders, doctoral candidates, and exceptional Master’s graduates in biology, physics, chemistry, or related disciplines to join a high-impact AI research initiative in partnership with a leading AI lab. This role involves evaluating and enhancing large language models (LLMs) by applying deep subject-matter expertise in graduate-level science to rigorously benchmark model performance.
- Evaluate accuracy, scientific depth, and domain relevance of LLM-generated answers across the listed domains.
- Review outputs spanning advanced topics in molecular biology, genetics, classical mechanics, quantum physics, physical chemistry, computer science, engineering, and humanities.
- Identify factual inaccuracies, logical flaws, and reasoning gaps.
- Work independently and asynchronously using provided tools.
Qualifications
- PhD (or PhD candidate) in Biology, Physics, Chemistry, Engineering, Computer Science, Mathematics, or related STEM field.
- Strong familiarity with graduate-level science and research problem solving.
- Excellent written communication and attention to detail.
- Comfortable working independently and remotely.
- Basic Python knowledge preferred, not required.
Requirements
- Part-time (20 hours/week).
- Remote and asynchronous.
Compensation
- Contractor position via Mercor.
- $35–$60/hour based on expertise.
- Weekly payments via Stripe Connect.