A Multicentric Validation Study on the Accuracy of Artificial Intelligence Assisted System in Clinical Application of Digestive Endoscopy
Overview
- Phase
- Not Applicable
- Intervention
- Not specified
- Conditions
- Gastrointestinal Disease
- Sponsor
- Renmin Hospital of Wuhan University
- Enrollment
- 10000
- Locations
- 1
- Primary Endpoint
- Accuracy
- Status
- Active, not recruiting
- Last Updated
- 5 years ago
Overview
Brief Summary
This is an artificial intelligence-based optical artificial intelligence assisted system that can assist endoscopists in improving the quality of endoscopy.
Detailed Description
Endoscopic diagnosis and treatment play an important role in the discovery and treatment of gastrointestinal diseases.With the rapid increase in the number of endoscopies, the workload of endoscopists increases further.The high workload reduces the quality of endoscopy, leading to incomplete coverage and incomplete detection of lesions.With the rapid increase in the number of endoscopies, the workload of endoscopists increases further.The high workload reduces the quality of endoscopy, leading to incomplete coverage and incomplete detection of lesions.Therefore, carrying out deep learning and other artificial intelligence methods has good academic research and practical value for improving the quality of endoscopic diagnosis and treatment.The research and development, testing and functional evaluation of artificial intelligence devices need to use a large number of endoscopic images, and at the same time, the effectiveness and safety of artificial intelligence devices need to be verified in different hospitals and environments.Based on this, our research group intends to collect endoscopic image data from different hospitals for training and validation of the model.
Investigators
Eligibility Criteria
Inclusion Criteria
- •male or female aged 18 or above;
- •endoscopy and related examinations should be performed to further clarify the characteristics of digestive tract diseases;
- •be able to read, understand and sign the informed consent;
- •the researcher believes that the subject can understand the process of the clinical study, is willing and able to complete all the study procedures and follow-up visits, and cooperate with the study procedures;
Exclusion Criteria
- •have participated in other clinical trials, signed the informed consent and have been in the follow-up period of other clinical trials;
- •drug or alcohol abuse or psychological disorder in the last 5 years;
- •pregnant or nursing women;
- •subjects with previous history of gastrointestinal surgery;
- •the researcher considers that the subject is not suitable for endoscopy and related examination;
- •high-risk diseases or other special conditions that the investigator considers inappropriate for the subject to participate in the clinical trial.
Outcomes
Primary Outcomes
Accuracy
Time Frame: 2020.1.12-2023.12.31
Calculate the accuracy of AI's judgment on images and videos. Accuracy is :
Sensitivity
Time Frame: 2020.1.12-2023.12.31
Calculate the sensitivity of AI's judgment on images and videos. Sensitivity is : in the sample that is positive actually, the proportion that judges to be positive (for example, in the person that is really sick, be judged to be the proportion that is sick by the hospital), computation way is the ratio that true positive divides true positive add false negative (be positive actually, but judge is negative).
Specificity
Time Frame: 2020.1.12-2023.12.31
Calculate the specificity of AI's judgment on images and videos. Specificity is : in the samples that are actually negative, the proportion of those that are judged negative (for example, the proportion of those who are not actually ill, who are judged by the hospital to be not ill) is calculated as the ratio of true negative divided by true negative + false positive (actually negative, but judged positive).
Negative Predictive Value (NPV)
Time Frame: 2020.1.12-2023.12.31
The percentage of true negative to negative test results indicates the probability that the negative test results are non-cases.
Area Under the Curve (AUC)
Time Frame: 2020.1.12-2023.12.31
Calculate the area under the curve of AI's receiver operating characteristic (ROC) curve.
Positive Predictive Value (PPV)
Time Frame: 2020.1.12-2023.12.31
The percentage of true positive people in positive test results indicates the probability that the positive test results belong to true cases.
Receiver Operating Characteristic (ROC) Curve
Time Frame: 2020.1.12-2023.12.31
Definition 1:The subject's operating characteristic curve is a coordinate graph composed of false positive rate as the horizontal axis and true positive rate as the vertical axis, and the curve drawn by the subject under specific stimulus conditions due to the different judgment criteria. Definition 2:ROC curves were created by plotting the proportion of true positive cases (sensitivity) against the proportion of false positive cases (1-specificity), by varying the predictive probability threshold.
Secondary Outcomes
- Recall Rate(2020.1.12-2023.12.31)
- Negative Likelihood Ratio(2020.1.12-2023.12.31)
- mean Average Precision (mAP)(2020.1.12-2023.12.31)
- Sørensen-Dice coefficient (F1 score)(2020.1.12-2023.12.31)
- Positive Likelihood Ratio(2020.1.12-2023.12.31)