AI-Augmented Diagnostic Assessment With ENLIGHT Versus Independent Pathologist Review
试验速览
- 阶段
- 不适用
- 状态
- Enrolling By Invitation
- 发起方
- 入组人数
- 25
- 试验地点
- 1
- 主要终点
- Diagnostic performance of cancers
研究概览
简要总结
This study will evaluate whether artificial intelligence (AI) can enhance clinicians' accuracy, efficiency, and confidence in distinguishing lung adenocarcinoma (LUAD) from lung squamous cell carcinoma (LUSC) and kidney renal papillary cell carcinoma (KIRP) from kidney renal clear cell carcinoma (KIRC) using digitized pathology slides. These subtype classifications are routinely performed by pathologists but can be challenging and time-consuming, particularly in difficult cases.
During the study, participating clinicians will review lung and kidney pathology slides under three different conditions:
- Unaided Review: Diagnosis without AI assistance.
- AI as Double-Check: The clinician first makes an independent diagnosis, after which the AI-generated diagnosis (prediction only or prediction with explanation) is revealed for review.
- AI as First-Look: The AI-generated diagnosis (prediction only or prediction with explanation) is presented before the clinician begins the review.
Clinicians will be randomly assigned to different review sequences to minimize potential order effects. This study design will enable us to assess the impact of AI assistance on diagnostic accuracy, interpretation time, and clinician confidence.
详细描述
This study aims to evaluate the effect of artificial intelligence (AI) assistance on clinicians' diagnostic performance in distinguishing lung adenocarcinoma (LUAD) from lung squamous cell carcinoma (LUSC) and kidney renal papillary cell carcinoma (KIRP) from kidney renal clear cell carcinoma (KIRC) using digitized hematoxylin and eosin (H&E)-stained whole-slide images (WSIs). ENLIGHT (Explainable Neoplasm Learning In Grounded Histology Terms) will serve as the AI system under evaluation. This is a single-session, within-reader, between-case study in which each reader evaluates distinct sets of cases under all study conditions.
The study includes three diagnostic blocks: Block X, in which WSIs are reviewed without AI assistance; Block Y1, in which clinicians make an initial diagnosis before viewing the AI output as a double-check; and Block Y2, in which the AI output is displayed before clinicians begin their review as a first-look aid. Within each AI-assisted block, the prediction-only and prediction-with-explanation sub-blocks are presented in randomized order.
Each participating pathologist will review up to 400 de-identified WSIs (up to 200 lung cancer and up to 200 kidney cancer cases). Readers will be randomly assigned to one of four study arms that differ only in the order in which Blocks X, Y1, and Y2 are completed. For each reader, distinct WSIs will be randomly assigned to the diagnostic conditions so that no WSI is reviewed more than once by the same reader.
- Arm 1 (X -> Y1 -> Y2): Clinicians first complete Block X (Unaided Review), followed by Block Y1 (AI as Double-Check) and then Block Y2 (AI as First-Look).
- Arm 2 (X -> Y2 -> Y1): Clinicians first complete Block X (Unaided Review), followed by Block Y2 (AI as First-Look) and then Block Y1 (AI as Double-Check).
- Arm 3 (Y1 -> Y2 -> X): Clinicians first complete Block Y1 (AI as Double-Check), followed by Block Y2 (AI as First-Look), and then Block X (Unaided Review).
- Arm 4 (Y2 -> Y1 -> X): Clinicians first complete Block Y2 (AI as First-Look), followed by Block Y1 (AI as Double-Check), and then Block X (Unaided Review).
For each case, diagnostic accuracy, time to diagnosis, and diagnostic confidence will be recorded. No reader will review the same WSI under more than one condition, thereby eliminating within-reader recall bias. In parallel, the ENLIGHT model will independently generate diagnostic predictions for all WSIs to enable direct benchmarking of AI performance against pathologists and to evaluate the impact of different AI-assisted workflows on diagnostic performance.
研究设计
- 研究类型
- Interventional
- 分配方式
- Randomized
- 干预模型
- Crossover
- 主要目的
- Diagnostic
- 盲法
- Quadruple (Participant, Care Provider, Investigator, Outcomes Assessor)
入排标准
- 性别
- All
- 接受健康志愿者
- 否
入选标准
- •for Pathology Slides (i.e., Cases):
- •Hematoxylin and eosin (H&E)-stained pathology slides
- •Final diagnosis confirmed through molecular testing in conjunction with expert pathology evaluation
排除标准
- •for Pathology Slides (i.e., Cases):
- •Poor-quality or unreadable slides
- •Cases used in AI training
- •Inclusion Criteria for Readers (i.e., Participants):
- •Board-certified or board-eligible pathologists
- •Willingness to complete both unaided and AI-assisted review sessions
结局指标
主要结局
Diagnostic performance of cancers
时间窗: Periprocedural (at the time of slide review)
Performance of clinicians (unaided and AI-assisted) for distinguishing LUAD- LUSC and distinguishing KIRP-KIRC, measured in accuracy, sensitivity, specificity, positive predictive value, negative predictive value, and F1.
次要结局
- Time to diagnosis(Periprocedural (at the time of slide review))
- Inter-observer variability(Periprocedural (at the time of slide review))
- Net benefit after AI exposure(Periprocedural (at the time of slide review))
- Clinician confidence level(Periprocedural (at the time of slide review))
研究者
Kun-Hsing Yu
Associate Professor
Harvard Medical School (HMS and HSDM)