ChatGPT v.s. Human in Writing a Preoperative Visit Sheet

Not yet recruiting

• Conditions: Preoperative Care
• Interventions: Other: Clinician; Other: ChatGPT-4

• Registration Number: NCT05945004
• Lead Sponsor: Boston Intelligent Medical Research Center, Shenzhen United Scheme Technology Co., Ltd.

Brief Summary

The goal of this study is to evaluate the performance of large language models i.e. ChatGPT, in making preoperative visit sheets using clinical records. The main questions it aims to answer are:

* Can large language models read clinical records and make preoperative visit sheets same as physicians?

* Can physicians distinguish preoperative visit sheets made by physicians and models?

Participants' records will be generated using ChatGPT-4, and read by both ChatGPT-4 and physicians to make 2 separate preoperative visit sheets, and form 2 groups, GPT group and physician group respectively.

A group of professionals will compare result of above mentioned 2 groups to see if ChatGPT can afford to write preoperative visit sheets.

Detailed Description

Not available

Study Timeline

• Study First Submitted: 2023-06-30
• Status Verified: 2023-07
• Study First Submitted QC: 2023-07-11
• Last Update Submitted: 2023-07-11
• Study First Posted: 2023-07-14
• Last Update Posted: 2023-07-14
• Study Start: 2023-08-01
• Primary Completion: 2023-08-15
• Study Completion: 2023-09-01

Recruitment & Eligibility

• Status: NOT_YET_RECRUITING
• Sex: All
• Target Recruitment: 120

Inclusion Criteria

• Any as records are generated using ChatGPT-4.

Exclusion Criteria

• Any as records are generated using ChatGPT-4.

Study & Design

• Study Type: OBSERVATIONAL
• Study Design: Not specified

Arm && Interventions

Group	Intervention	Description
Control	Clinician	-
Experiment	ChatGPT-4	-

Primary Outcome Measures

Name	Time	Method
Familiarity to human writing	Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.	Based on professionals' subjective evaluation, familiarity is a binary result indicating weather professionals think the preoperative visit sheet was written by physicians or ChatGPT, where 0 indicates "not written by human" and 1 indicates "written by human".
Satisfaction for clinical use	Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.	A grading score of 1-10 indicating weather the professionals think the preoperative visit sheet is suitable in clinical use.