About the job
We are a global leader in advanced information and decision support for science and healthcare and we are seeking a MD or DO board-certified in Family Medicine, Internal Medicine, or Emergency Medicine.
You will review AI-generated content and evaluate it based on usefulness, relevance, authority, accuracy, completeness, fluency, use of local terminology, and identification of hallucinations, misattributions, unsupported statements, and other quality issues.
Project Duration: January 2026 – December 31, 2026 (with possible extension)
Hours: The hours will be consistent weekly but are given on a first-come, first-serve basis. So you’re expected to be able to contribute 5-10 hours weekly, consistently. You can do the work completely on your own time (days, nights, or weekends, or whenever your schedule permits, as long as you can commit 5-10 hours weekly)
Project Overview:
Domain experts across multiple disciplines will review AI-generated content and evaluate it based on usefulness, relevance, authority, accuracy, completeness, fluency, use of local terminology, and identification of hallucinations, misattributions, unsupported statements, and other quality issues.
Role Summary:
This is a 100% remote, flexible position. You will work at your convenience on a first-come, first-served basis. Tests containing 10–120 prompts are loaded into an accessible tool, and domain experts are notified via email when prompts become available. Each prompt requires three raters. Work is expected to be relatively steady, with evaluations likely conducted monthly and prompt fixes implemented between test uploads.
Requirements by Domain:
- MedicineMD or DO board-certified in Family Medicine, Internal Medicine, or Emergency Medicine
- Active, unencumbered medical license
- Currently in clinical practice (telemedicine acceptable)
- Minimum 2 years post-residency graduation practice experience
- Research background (preferred by not required)
- Previous experience rating AI-generated content (preferred but not required)
Requirements added by the job poster
• Authorized to work in the United States
• 2+ years of experience in Health Care Provider
• No need for visa sponsorship
