A Preregistered Multi-Cohort Evaluation of the FATHOM AI System for Molecular Testing Prioritization to Support Clinical Trial Enrollment

Summary

Many clinical trials evaluating cancer treatments require patients to undergo testing for specific molecular markers as part of eligibility screening, typically using immunohistochemistry or sequencing. Because relatively few patients may carry a required marker, trial investigators often test large numbers of patients to identify the few who may ultimately qualify for enrollment. Pathology laboratories routinely produce hematoxylin-and-eosin (H\&E) slides during cancer diagnosis. Pathology foundation models-large neural networks pretrained on millions of histology images-have shown promise in predicting molecular characteristics from these slides. Researchers can use these models to build classifiers that predict specific molecular markers and prioritize patients for confirmatory testing. This study evaluates FATHOM (Facilitating Accrual through Tumor Histology and Omics Matching), an autonomous research system powered by large multimodal models. Its agents read registered clinical trial records, identify molecular markers used as enrollment criteria, build prediction models using pathology foundation models, select the individual models or model combinations that best meet prespecified criteria, set their decision thresholds, and determine whether to deploy them. Together, a prediction model, its decision threshold, and the decision to deploy it constitute an AI prediction policy. Before FATHOM runs, the investigators preregister the clinical trial records that its agents may read, the cutoff date that defines which trial information they may use, the rules governing the agents, and the analysis plan. The system timestamps and locks each policy immediately after an agent produces it. The investigators then apply the policies to archived patient slides and compare their predictions with existing molecular marker results. The primary outcome is the proportion of prespecified evaluation scenarios in which an agent-generated policy, compared with universal molecular testing, either enriches the population selected for confirmatory testing with marker-positive patients or safely spares patients from confirmatory testing while meeting prespecified performance criteria. This study analyzes existing pathology images and clinical trial records only. It does not enroll or contact patients, influence patient care, or affect participation in any clinical trial.