Evaluate the Performance of Large Language Models in Ophthalmologic Patient Consultation

Not Applicable

Not yet recruiting

• Conditions: Non-emergency Ocular Diseases

• Registration Number: NCT06824389
• Lead Sponsor: Zhongshan Ophthalmic Center, Sun Yat-sen University

Brief Summary

The intelligent image models lack an understanding of diagnostic and treatment logic, and have not considered textual information such as symptoms and signs. Large language models like ChatGPT, can learn medical knowledge, understand, and generate human natural language, offering new technologies for medical knowledge-based intelligent question answering and the creation of smart medical documents. Therefore, our team plan to verify large language models' feasibility and effectiveness in ophthalmology clinics for medical history collection and examination recommendations during consultations, comparing its performance with traditional methods.

Detailed Description

Not available

Study Timeline

• Status Verified: 2025-01
• Study Start: 2025-02
• Study First Submitted: 2025-02-05
• Study First Submitted QC: 2025-02-12
• Last Update Submitted: 2025-02-12
• Study First Posted: 2025-02-13
• Last Update Posted: 2025-02-14
• Primary Completion: 2026-03
• Study Completion: 2026-12

Recruitment & Eligibility

• Status: NOT_YET_RECRUITING
• Sex: All
• Target Recruitment: 172

Inclusion Criteria

• No age or gender restrictions for patients.
• Non-emergency ocular diseases including corneal diseases, lens disorders, and vitreoretinal diseases.
• Voluntary participation with signed informed consent.

Exclusion Criteria

• Top 10 Ocular Emergencies: globe perforation, ocular chemical injury, corneal ulcer perforation, Pseudomonas aeruginosa keratitis, acute angle-closure glaucoma, acute panophthalmitis, central retinal artery occlusion, acute optic neuritis, endophthalmitis, and orbital cellulitis.

Study & Design

• Study Type: INTERVENTIONAL
• Study Design: PARALLEL

Primary Outcome Measures

Name	Time	Method
Medical History Collection Scoring	through study completion, up to 1 week.	The medical history collection is performed using the standard outpatient medical record form. The scoring criteria are developed collaboratively by clinical doctors from multiple specialties and researchers. Scoring is independently conducted in a blinded manner by higher-level specialists.

Secondary Outcome Measures

Name	Time	Method
Accuracy of Recommended Tests	through study completion, up to 1 week.	The gold standard for both the experimental and control groups consists of test items independently selected by senior specialists, who are not involved in the study.
Duration of Medical History Collection	through study completion, up to 1 week.	The experimental group uses the developed system to record the consultation and medical record writing completion times, while the control group records the consultation time through audio recording and the medical record writing completion time through the developed system.
Patient satisfaction	through study completion, up to 1 week.	Collected through a questionnaire.