Job description
This project involves reviewing Al-generated responses, evaluating the reasoning quality and step-by-step problem-solving, and providing expert feedback that helps models produce answers that are accurate, logical, and clearly explained. You will assess solutions for accuracy, clarity, and adherence to the prompt; identify errors in methodology, or conceptual understanding; fact-check information across; write high-quality medical explanations and model solutions that demonstrate correct methods; and rate and compare multiple Al responses based on medical correctness and reasoning quality.
Compensation
Compensation is competitive and varies based on education level and prior experience.
Hiring Profile
• You hold (or are pursuing) a Medical degree
• Expert at fact-checking information using public sources across multiple domains.
• English proficiency C1 and above with excellent writing skills.
• Bonus: Data labeling, RLHF, or Al model evaluation experience.
Application & Onboarding Process
- Apply via partner site - Braintrust will send you an email with detailed instructions.
• Qualification exam (1-2 hours): evaluates your role-specific expertise. Compensation provided upon passing.
• Project exam (1-2 hours): evaluates your adherence to project guidelines and ability to produce physics-specific deliverables. Compensation provided upon passing.
Commitment
• We expect a minimum of 17-20 hours per week, however considering the project
scope and timelines the preferred and recommended commitment would be 8
hours/day.
