Physician Usability and Output Quality Evaluation of a Retrieval-Augmented Language Model System for Specialty Medical Consultation: A Human-Computer Interaction Study

Summary

The goal of this study is to test an artificial intelligence (AI) tool called SAGE. SAGE helps primary care doctors with questions that often need a specialist. Primary care doctors are the doctors people usually see first. SAGE reviews a case and suggests what a specialist might advise. The main questions it aims to answer are: * Do doctors make sound, timely care decisions when they use SAGE? * Do those decisions match what a specialist would advise? Researchers will compare the decisions doctors make with and without SAGE. Doctors in the study will: * Review made-up patient cases (these are not real patients) * Make a decision for each case, their usual way and with SAGE

Eligibility

Age range

18+ years

Sex

All

Healthy volunteers

Yes

Interventions

• Other
  SAGE (AI clinical decision support)

  SAGE is an artificial intelligence (AI) based clinical decision support tool. It generates specialty-informed recommendations for a primary care consultation question. Physicians review the SAGE output while making a management decision for the synthetic case.

• Other
  Standard eConsult

  A standard electronic consultation (eConsult) format, without SAGE. Physicians review this information while making a management decision for the synthetic case.

Location