ChatGPT Versus Physical Medicine and Rehabilitation Residents

Completed

• Conditions: Artificial Intelligence (AI); Resident Education

• Registration Number: NCT06775938
• Lead Sponsor: Sisli Hamidiye Etfal Training and Research Hospital

Brief Summary

The aim of this study was to assess the performance of ChatGPT on examinations administered to physical medicine and rehabilitation (PMR) residents.

Detailed Description

These exams for resident physicians are annual exams administered throughout the training period, which constitute a fundamental component of the training process towards becoming a PMR physician. In this study, we evaluated the performance of ChatGPT in these exams, made separate assessments for each training year, and compared the results of ChatGPT with the results of residents who passed the same exam.

Study Timeline

• Status Verified: 2025-01
• Study Start: 2025-01-01
• Study First Submitted: 2025-01-02
• Primary Completion: 2025-01-10
• Study Completion: 2025-01-10
• Study First Submitted QC: 2025-01-14
• Last Update Submitted: 2025-01-14
• Study First Posted: 2025-01-15
• Last Update Posted: 2025-01-15

Recruitment & Eligibility

• Status: COMPLETED
• Sex: All
• Target Recruitment: 314

Inclusion Criteria

• Physical medicine and rehabilitation residents exam results in May 2024

Exclusion Criteria

Study & Design

• Study Type: OBSERVATIONAL
• Study Design: Not specified

Primary Outcome Measures

Name	Time	Method
The comparison of resident exam results and ChatGPT answers to the same questions	through study completion, an average of 10 days	In May 2024, the exam results of residents in training and research hospitals affiliated with the Health Sciences University across Türkiye will be compared with the answers and rankings given by ChatGPT to the same questions. ChatGPT accuracy rate and response time to questions will be determined. The minimum score to be obtained from this exam is 0 and the maximum score is 100.

Trial Locations

Locations (1)

Şişli Hamidiye Etfal Training and Research Hospital; 🇹🇷 İstanbul, Sarıyer, Turkey