Multi-Reader Retrospective Study Examining Carebot AI CXR 2.0.21-v2.01 Implementation in Everyday Radiology Clinical Practice
试验速览
- 阶段
- 不适用
- 状态
- 已完成
- 入组人数
- 956
- 试验地点
- 2
- 主要终点
- Performance test
研究概览
简要总结
The primary objective is to evaluate the performance parameters of the proposed DLAD (Carebot AI CXR) in comparison to individual radiologists.
详细描述
In the period between October 18th, 2022, and November 17th, 2022, anonymized chest X-ray images of patients were collected at the Radiodiagnostic Department of the Havířov Hospital, p.o. The collection process involved utilizing the CloudPACS imaging and archiving system provided by OR-CZ spol. s r.o.
The collected X-ray images were subjected to the proposed DLAD (Carebot AI CXR) for analysis. Subsequently, the DLAD's performance was compared with the standard clinical practice, where radiologists assessed the CXR images in the simulated hospital setting with access to standard viewing tools (e.g., pan, zoom, WW/WL) and were given an unlimited amount of time to complete the review. Each radiologist determined the presence or absence of 7 indicated radiological findings, including atelectasis (ATE), consolidation (CON), pleural effusion (EFF), pulmonary lesion (LES), subcutaneous emphysema (SCE), cardiomegaly (CMG), and pneumothorax (PNO).
研究设计
- 研究类型
- Observational
- 观察模型
- Cohort
- 时间视角
- Retrospective
入排标准
- 年龄范围
- 18 Years 至 —（Adult, Older Adult）
- 性别
- All
- 接受健康志愿者
- 否
入选标准
- •Hospital patients > 18 years who were referred for chest radiography October 18th, 2022, and November 17th, 2022 at the Radiodiagnostic Department of the Havířov Hospital, p.o.
排除标准
- •Patients < 18 years
- •Chest X-ray images in lateral positions
- •Duplicated chest X-ray images
结局指标
主要结局
Performance test
时间窗: March 2023
The primary objective is to evaluate the performance parameters of the proposed DLAD (Carebot AI CXR) in comparison to individual radiologists. The performance test includes sensitivity and specificity, positive and negative likelihood ratio, and positive and negative predictive value. The aforementioned parameters are statistically compared using confidence intervals (CI) and p-Values. The comparison procedure consists of two steps: a global hypothesis test is conducted to determine whether there are significant differences between DLAD and radiologists. If the global hypothesis test yields a significant result, individual hypothesis tests are performed. Additionally, multiple comparison methods, such as McNemar with continuity correction for Se and Sp, Holm method for LRs, and weighted generalized score statistics for PVs, are applied to control the overall error rate. All tests are performed as two-tailed tests at the 5% significance level.
次要结局
未报告次要终点