Company: Handshake
Country: United States
Location: Remote
Job Type: Contract
Salary: USD0.00 - USD0.00
The AI Evaluator (Radiology) leverages clinical imaging expertise to evaluate, validate, and improve AI-generated content related to medical imaging interpretation, diagnostic reasoning, reporting accuracy, and clinical decision support. This role ensures AI outputs are clinically sound, safe, and aligned with real-world radiology practice.
As an AI Evaluator, you will review and assess AI-generated responses, case analyses, diagnostic explanations, and simulated scenarios involving radiologic imaging and interpretation. You will identify diagnostic inaccuracies, clinical risks, ambiguous reasoning, and workflow misalignment, providing structured feedback to enhance AI model performance and reliability in healthcare contexts. Key responsibilities include: - Evaluating AI-generated content related to diagnostic imaging (e.g., X-ray, CT, MRI, ultrasound, nuclear medicine) - Validating clinical accuracy, diagnostic logic, and appropriateness of imaging interpretations - Assessing realism of case scenarios, differential diagnoses, and reporting language - Applying structured evaluation rubrics to score AI outputs and recommend improvements - Flagging patient-safety risks, misleading interpretations, or non-clinical recommendations - Contributing expert feedback to improve AI performance in medical and clinical settings
- 4+ years of professional experience practicing as a Radiologist - Strong knowledge of diagnostic imaging modalities, clinical workflows, and reporting standards - Experience interpreting imaging studies in a clinical or hospital-based environment - Ability to critically evaluate medical content and provide clear, structured written feedback - High attention to detail, clinical judgment, and patient safety awareness - Comfortable working remotely and reviewing written, visual, or scenario-based content Compensation Per completed evaluation task (rate may vary based on scope and complexity)
Application Deadline: 30 June, 2026
Job Status:
Submit Application