All roles

[Remote] AI Prompt Engineer – HLE (Humanity’s Last Exam

Remote · USA Full-time New today

Note The job is a remote job and is open to candidates in USA. MyRemoteTeam Inc is building elite teams to evaluate and advance the next generation of GenAI models. The AI Prompt Engineer will review and refine prompts, analyze model responses, and collaborate with researchers to create evaluation frameworks, ensuring high-quality outputs and human reasoning alignment.

Responsibilities

  • Review, analyze, and refine prompts used to train cutting-edge GenAI systems.
  • Decide which model responses are correct, incorrect, higher quality, or more aligned with human reasoning.
  • Work with GenAI researchers & engineers to understand evaluation goals and data workflows.
  • Convert high-level requirements into clear, detailed evaluation frameworks.
  • Create research-backed, high-difficulty questions that challenge AI models ("Humanity’s Last Exam" style).
  • Conduct deep research using large language models and trusted sources.
  • Innovate new prompt strategies and evaluation rubrics.
  • Ensure factual accuracy, recall, precision, and bias-free content.
  • Maintain extremely high quality while working with minimal supervision. Skills
  • Review, analyze, and refine prompts used to train cutting-edge GenAI systems.
  • Decide which model responses are correct, incorrect, higher quality, or more aligned with human reasoning.
  • Work with GenAI researchers & engineers to understand evaluation goals and data workflows.
  • Convert high-level requirements into clear, detailed evaluation frameworks.
  • Create research-backed, high-difficulty questions that challenge AI models ('Humanity’s Last Exam' style).
  • Conduct deep research using large language models and trusted sources.
  • Innovate new prompt strategies and evaluation rubrics.
  • Ensure factual accuracy, recall, precision, and bias-free content.
  • Maintain extremely high quality while working with minimal supervision.
  • Strong writing and content development experience.
  • Ability to design complex, original problems across your domain.
  • Deep research and fact-checking ability.
  • A unique human voice — no AI-style mimicry.
  • Precision, logic, and top-tier attention to detail.
  • Strong prompt engineering skills (few-shot, chain-of-thought, reasoning prompts, etc.).
  • Familiarity with LLM behavior, limitations, and error patterns.
  • Experience using AI tools for research and refinement.
  • Ethical understanding of bias mitigation and responsible AI usage.
  • Solid data literacy for LLM training workflows (cleaning, verification, preparation).
  • Master’s with distinction or PhD preferred.
  • Fields Finance, Engineering, Physics, Chemistry, Medicine.
  • Bachelor’s degree accepted with proven advanced experience.
  • Graduated from leading US or international institutions (preferred). Company Overview
  • MyRemoteTeam.com is a quick & easy way for Businesses to Pay Remote Teams, Employees, Consultants & Freelancers. It was founded in 2017, and is headquartered in Claymont, Delaware, USA, with a workforce of 11-50 employees. Its website is Apply tot his job Apply To this Job Apply tot his job Apply To this Job

Apply tot his job Apply To this Job

Related roles

SR Prompt Engineer - CRE Technology - Remote

Remote · USA Full-time

[Remote] Prompt Engineer (Chinese) | $43/hr Remote

Remote · USA Full-time

AI Prompt Engineer, Remote

Remote · USA Full-time

Prompt Engineer (100% Worldwide Remote) in Los Angeles, CA in vidIQ

Remote · USA Full-time

[Remote] AI Prompt Engineer & Evaluator | $50/hr Remote

Remote · USA Full-time

[Remote] AI/Prompt Engineer – Intern/Entry Level

Remote · USA Full-time

Project Lion - Senior Prompt Engineer - United States (Remote, Part-Time)

Remote · USA Full-time

Junior Prompt Engineer; Remote

Remote · USA Full-time

AI Prompt Enginer

Remote · USA Full-time

Computer Vision Engineer/Data Scientist

Remote · USA Full-time

Data Scientist

Remote · USA Full-time

Customer Service Representative – Member Care & Support Specialist for arenaflex Health Services (24/7 Call Center)

Remote · USA Full-time

Senior Oncology Specialist - EMERALD - Dallas, TX

Remote · USA Full-time

Remote Healthcare Customer Service Representative – Patient Support, Insurance Navigation, and Service Excellence

Remote · USA Full-time

Remote Admissions Officer - ECPI University (Louisville, KY)

Remote · USA Full-time

Software Developer-Amazon Los Angeles

Remote · USA Full-time

Regional Sales Director

Remote · USA Full-time

Experienced Healthcare Patient Customer Service Representative – Revenue Cycle Management

Remote · USA Full-time

Sr. End User Support Specialist

Remote · USA Full-time

Backend Engineer, Senior

Remote · USA Full-time