Accuracy of an Artificial Intelligence-Based System for Diagnosing Anxiety Disorders: A Paired Comparison With Psychiatrist Clinical Diagnoses
Overview
- Phase
- Not Applicable
- Status
- Not yet recruiting
- Enrollment
- 100
- Locations
- 1
- Primary Endpoint
- Diagnostic Accuracy (Sensitivity, Specificity, and Area Under the Curve) of the AI-Based Screening System for Anxiety Disorders
Overview
Brief Summary
The trial aimed to evaluate the efficacy of an artificial intelligence-based system for diagnosing anxiety disorders. Specifically, it sought to determine whether the system's assessment validity is non-inferior to that of psychiatric specialists.
Detailed Description
This study evaluates the performance of the AI-assisted diagnostic system for identifying anxiety disorders and its applicability in clinical settings. Utilizing a paired design with psychiatrists' clinical diagnoses as the gold standard, the study compares the system's diagnostic results with those of physicians to determine sensitivity and specificity, thus validating its clinical effectiveness in real-world outpatient scenarios. Additionally, standardized scales are used to assess users' perceptions of the system's usability, trustworthiness, and satisfaction, offering evidence to support the clinical integration of AI technology in mental health screening.
Study Design
- Study Type
- Observational
- Observational Model
- Case Control
- Time Perspective
- Cross Sectional
Eligibility Criteria
- Ages
- 18 Years to 60 Years (Adult)
- Sex
- All
- Accepts Healthy Volunteers
- Yes
Inclusion Criteria
- •In accordance with ICD-11 for Anxiety Disorders;
- •Between the ages of 18-60;
- •Ability to use computers or smartphone;
- •Native Chinese speaker;
- •Signing informed consent.
Exclusion Criteria
- •With severe psychiatric symptoms requiring hospitalization, or unable to complete the required assessment and treatment;
- •With a high risk of suicide or self-injury;
- •With severe physical diseases, central nervous system diseases, or substance abuse;
- •With intellectual, visual, or auditory impairments that affect their ability to interact with aided-diagnostic systems.
- •Health Control
- •Inclusion Criteria:
- •Not meet ICD-11 criteria for Mental Disorders;
- •Between the ages of 18-60;
- •Ability to use computers or smartphone;
- •Native Chinese speaker;
Outcomes
Primary Outcomes
Diagnostic Accuracy (Sensitivity, Specificity, and Area Under the Curve) of the AI-Based Screening System for Anxiety Disorders
Time Frame: through study completion, an average of 1 week
In this study, the evaluation results of the subjects were taken as the gold standard based on the diagnostic conclusions of psychiatrists. The screening results of the aided-diagnostic system were compared with the diagnostic conclusions of the psychiatrists to verify the screening effectiveness of this system. Sensitivity : Calculated as \[True Positives / (True Positives + False Negatives)\], evaluating the AI system's ability to correctly identify patients with anxiety. Specificity : Calculated as \[True Negatives / (True Negatives + False Positives)\], evaluating the AI system's ability to correctly exclude non-anxious individuals.Area Under the Receiver Operating Characteristic Curve (AUC), which comprehensively evaluates the diagnostic discriminative power of the system by plotting sensitivity versus 1-specificity across different decision thresholds and calculating the AUC value .
Secondary Outcomes
No secondary outcomes reported