Multicenter Randomized Controlled Trial of a Multimodal AI Agent for Ophthalmology Clinical Decision Support
Overview
- Phase
- Not Applicable
- Status
- Not yet recruiting
- Enrollment
- 300
- Locations
- 1
- Primary Endpoint
- Diagnostic accuracy rate
Overview
Brief Summary
This study is a multicenter randomized controlled trial evaluating the effectiveness and safety of EyeAgent, a multimodal artificial intelligence (AI) agent designed to assist ophthalmologists in clinical decision-making. Participants will be recruited from ophthalmology clinics and hospitals in Hong Kong and mainland China. The AI agent acts as a digital co-pilot, analyzing patient images and clinical history to provide diagnostic and management recommendations. The trial aims to determine whether the use of the AI agent improves diagnostic accuracy, treatment decision-making performance, report generation, workflow efficiency, and user satisfaction compared to standard clinical practice.
Detailed Description
This multicenter, randomized controlled trial aims to evaluate the integration of EyeAgent, a multimodal artificial intelligence (AI) agent, in real-world clinical settings. The AI system is designed to support clinicians by analyzing patient data, including ocular images and electronic health records, to aid in image interpretation, diagnosis, and treatment planning.
A total of 300 participants will be randomly assigned to either an AI-assisted care arm or a standard care arm. In the AI-assisted arm, clinicians review the comprehensive report generated by AI agent as a supportive tool before finalizing their independent decisions. The study comprehensively measures diagnostic accuracy, the rate of inappropriate treatment decisions, report generation, workflow efficiency, and user questionnaire.
By comparing these two groups, the trial aims to provide robust evidence on the effectiveness and practical utility of AI-driven clinical decision support in ophthalmology, with the goal of enhancing both the quality and efficiency of patient care.
Study Design
- Study Type
- Interventional
- Allocation
- Randomized
- Intervention Model
- Parallel
- Primary Purpose
- Other
- Masking
- Double (Participant, Outcomes Assessor)
Eligibility Criteria
- Ages
- 6 Years to 75 Years (Child, Adult, Older Adult)
- Sex
- All
- Accepts Healthy Volunteers
- Yes
Inclusion Criteria
- •Outpatient participants aged 6 to 75 years.
- •Participants who undergo ophthalmic examinations for medical purposes during the study period.
- •Participants who can produce clear ophthalmic images in both eyes.
- •Agree to participate in this study with written informed consent:
- •Participants aged 18 years or older provide their own consent.
- •Participants aged 6-17 years require consent from a parent or legal guardian.
Exclusion Criteria
- •Participants who are reluctant to participate in this study.
- •Participants presenting with acute or emergency ocular conditions requiring immediate intervention.
- •Participants with poor quality of ophthalmic images, including blurriness, artifacts, underexposure, or overexposure.
- •Other unsuitable reasons determined by the evaluators.
Arms & Interventions
AI-assisted care arm
Clinicians perform report generation, diagnosis, and treatment planning with support from the EyeAgent system.
Intervention: EyeAgent AI system (Device)
Standard care arm
Clinicians provide routine ophthalmic care without support from the EyeAgent system.
Outcomes
Primary Outcomes
Diagnostic accuracy rate
Time Frame: Immediately after the intervention.
Proportion of diagnoses consistent with a reference expert panel.
Rate of inappropriate treatment decisions
Time Frame: Immediately after the intervention.
The frequency of treatment recommendations (e.g., injection, laser therapy, or observation) that deviate from clinical guidelines as determined by the senior expert panel gold standard. Expert adjudication is conducted post-hoc after the enrollment phase concludes.
Secondary Outcomes
- Report quality(Within 1 month after enrollment.)
- Clinician confidence(Immediately after the intervention.)
- Workflow efficiency(During the index diagnostic session.)
- Satisfaction and usability(At the end of each clinician's participation period, approximately 2 months.)