Using Natural Language Processing Models for Writing Preoperative Visit Sheets: a Preliminary Study Comparing ChatGPT and Clinicians
试验速览
- 阶段
- 不适用
- 状态
- 尚未招募
- 发起方
- 入组人数
- 120
- 主要终点
- Familiarity to human writing
研究概览
简要总结
The goal of this study is to evaluate the performance of large language models i.e. ChatGPT, in making preoperative visit sheets using clinical records. The main questions it aims to answer are:
- Can large language models read clinical records and make preoperative visit sheets same as physicians?
- Can physicians distinguish preoperative visit sheets made by physicians and models?
Participants' records will be generated using ChatGPT-4, and read by both ChatGPT-4 and physicians to make 2 separate preoperative visit sheets, and form 2 groups, GPT group and physician group respectively.
A group of professionals will compare result of above mentioned 2 groups to see if ChatGPT can afford to write preoperative visit sheets.
研究设计
- 研究类型
- Observational
- 观察模型
- Cohort
- 时间视角
- Cross Sectional
入排标准
- 性别
- All
- 接受健康志愿者
- 否
入选标准
- •Any as records are generated using ChatGPT-4.
排除标准
- •Any as records are generated using ChatGPT-4.
结局指标
主要结局
Familiarity to human writing
时间窗: Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.
Based on professionals' subjective evaluation, familiarity is a binary result indicating weather professionals think the preoperative visit sheet was written by physicians or ChatGPT, where 0 indicates "not written by human" and 1 indicates "written by human".
Satisfaction for clinical use
时间窗: Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.
A grading score of 1-10 indicating weather the professionals think the preoperative visit sheet is suitable in clinical use.
次要结局
未报告次要终点