Enhancing Interdisciplinary Understanding of Ophthalmology Notes Through Local Large Language Model
试验速览
- 阶段
- 不适用
- 状态
- 已完成
- 发起方
- 入组人数
- 851
- 试验地点
- 1
- 主要终点
- Non-Ophthalmologist Note Comprehension and Satisfaction
研究概览
简要总结
This prospective, randomized controlled trial evaluated the efficacy of adding Large Language model (LLM)-generated Plain Language Summaries (PLSs) to Standard Ophthalmology Notes (SONs) in enhancing comprehension among non-ophthalmology providers. The study utilized surveys to assess non-ophthalmology providers' comprehension and satisfaction with the notes and ophthalmologists' evaluation of PLS accuracy, safety, and time burden. An objective semantic and linguistic analysis of the PLSs was also conducted.
研究设计
- 研究类型
- Interventional
- 分配方式
- Randomized
- 干预模型
- Parallel
- 主要目的
- Health Services Research
- 盲法
- None
入排标准
- 年龄范围
- 18 Years 至 —（Adult, Older Adult）
- 性别
- All
- 接受健康志愿者
- 否
入选标准
- •Evaluation by an Ophthalmologist in the Mayo Clinic Department of Ophthalmology in Rochester, MN in either the inpatient or outpatient setting between Feb 1, 2024 - May 31, 2024.
排除标准
- •No in-network non-Ophthalmologist care providers in the medical record
- •Procedure-only visits containing only a procedure note
研究组 & 干预措施
Control
Participants receive standard ophthalmology notes without any additions.
Intervention
Participants receive standard ophthalmology notes with an appended LLM-generated plain language summary, reviewed and edited by the ophthalmologist. The plain language summary is clearly marked as generated as part of a Quality Improvement initiative.
干预措施: Large Language Model-generated Plain Language Summary of Ophthalmology notes (Other)
结局指标
主要结局
Non-Ophthalmologist Note Comprehension and Satisfaction
时间窗: From enrollment to 8 weeks after enrollment
Assessed via survey responses evaluating understanding of the patient\'s ophthalmology diagnosis, satisfaction with the note, and overall preference between Standard Ophthalmology Note and Standard Ophthalmology Note + Plain Language Summary. Degree of understanding was assessed on the following Likert scale: Not at all Neutral Moderately A great deal Satisfaction was graded on the following Likert scale: Not satisfied at all Somewhat unsatisfied Neutral Somewhat satisfied Satisfied Preference between note types was assessed on the following Likert scale: Standard Note, a great deal Standard Note, somewhat Neutral Plain Language Summary, somewhat Plain Language Summary, a great deal
次要结局
- Semantic and Linguistic Quality of Plain Language Summaries(Assessed at a single time point <24 hr following enrollment)
- Ophthalmologist Evaluation of Summary Accuracy and Time burden(Assessed at a single time point <24 hr after enrollment)
- Semantic and Linguistic Quality of Plain Language Summaries(Assessed at a single time point &lt;24 hr following enrollment)
研究者
John J Chen
Principal Investigator
Mayo Clinic