Clinical Validation of Machine Learning Triage of Chest Radiographs
Trial Snapshot
- Phase
- Not Applicable
- Status
- Withdrawn
- Sponsor
- Stanford University
- Locations
- 1
- Primary Endpoint
- Turnaround time
Study Overview
Brief Summary
Artificial intelligence and machine learning have the potential to transform the practice of radiology, but real-world application of machine learning algorithms in clinical settings has been limited. An area in which machine learning could be applied to radiology is through the prioritization of unread studies in a radiologist's worklist. This project proposes a framework for integration and clinical validation of a machine learning algorithm that can accurately distinguish between normal and abnormal chest radiographs. Machine learning triage will be compared with traditional methods of study triage in a prospective controlled clinical trial. The investigators hypothesize that machine learning classification and prioritization of studies will result in quicker interpretation of abnormal studies. This has the potential to reduce time to initiation of appropriate clinical management in patients with critical findings. This project aims to provide a thoughtful and reproducible framework for bringing machine learning into clinical practice, potentially benefiting other areas of radiology and medicine more broadly.
Study Design
- Study Type
- Interventional
- Allocation
- Randomized
- Intervention Model
- Crossover
- Primary Purpose
- Diagnostic
- Masking
- Single (Participant)
Masking Description
Radiologists will be blinded when using machine learning and random triage methods.
Eligibility Criteria
- Ages
- 18 Years to — (Adult, Older Adult)
- Sex
- All
- Accepts Healthy Volunteers
- Yes
Inclusion Criteria
- •Radiologist at Stanford Hospital and Clinics
Exclusion Criteria
- Not provided
Arms & Interventions
Traditional workflow triage
Radiologists follow standard triage of chest radiographs.
Intervention: Traditional workflow triage (Other)
Traditional workflow triage
Radiologists follow standard triage of chest radiographs.
Intervention: Machine learning workflow triage (Other)
Traditional workflow triage
Radiologists follow standard triage of chest radiographs.
Intervention: Random workflow triage (Other)
Machine learning workflow triage
Radiologists follow machine learning triage of chest radiographs.
Intervention: Traditional workflow triage (Other)
Machine learning workflow triage
Radiologists follow machine learning triage of chest radiographs.
Intervention: Machine learning workflow triage (Other)
Machine learning workflow triage
Radiologists follow machine learning triage of chest radiographs.
Intervention: Random workflow triage (Other)
Random workflow triage
Radiologists follow randomly ordered triage of chest radiographs.
Intervention: Traditional workflow triage (Other)
Random workflow triage
Radiologists follow randomly ordered triage of chest radiographs.
Intervention: Machine learning workflow triage (Other)
Random workflow triage
Radiologists follow randomly ordered triage of chest radiographs.
Intervention: Random workflow triage (Other)
Outcomes
Primary Outcomes
Turnaround time
Time Frame: up to 1 hour
Time from completion of radiograph to time that radiologist issues an assessment via preliminary or final report
Secondary Outcomes
No secondary outcomes reported
Investigators
Emily Tsai
Clinical Assistant Professor
Stanford University
