Effect of AI Chatbot-Assisted Case-Based Learning on Clinical Reasoning in Occupational Therapy Students: A Post-Test Only Controlled Trial in Parkinson's Disease Education
试验速览
- 阶段
- 不适用
- 状态
- 已完成
- 发起方
- 入组人数
- 25
- 试验地点
- 2
- 主要终点
- Total Post-Test Score (0-24 points)
研究概览
简要总结
This study aims to examine whether using an artificial intelligence (AI) chatbot can enhance occupational therapy students' learning during a case-based activity focused on Parkinson's disease. The research compares two groups of students: one using traditional learning materials, and another using both traditional resources and a conversational AI chatbot. Students in both groups work in teams to analyze the same clinical case and propose assessment and treatment strategies for a hypothetical patient. The main purpose of the study is to evaluate whether the AI chatbot helps improve students' performance in three learning domains: cognitive (knowledge and understanding), affective (empathy and attitudes), and psychomotor (planning and action skills). Students' performance is assessed through a structured written examination. The hypothesis is that students who use the AI chatbot will achieve higher scores, especially in the cognitive and psychomotor domains, compared to those who rely on traditional methods only. The study also examines how students interact with the chatbot and whether they use it to support deeper clinical reasoning. By exploring the role of AI in occupational therapy education, this research seeks to inform future teaching strategies and support the thoughtful integration of digital tools in health professions training.
详细描述
This study investigates the impact of an artificial intelligence (AI) chatbot on occupational therapy (OT) students' clinical reasoning skills within the context of neurological rehabilitation, specifically focusing on Parkinson's disease. The study uses a post-test only control group design and adopts a mixed-methods approach to assess educational outcomes across three learning domains: cognitive, affective, and psychomotor.
A total of 25 OT undergraduate students enrolled in a Neurological Rehabilitation course are randomly assigned to one of two groups: (1) Chatbot Group and (2) Classic Group. Both groups receive the same didactic instruction and engage in a small-group, case-based learning session featuring a hypothetical Parkinson's disease case. The Classic Group uses traditional learning resources such as lecture notes and textbooks, while the Chatbot Group additionally interacts with an AI language model simulating a patient. The chatbot allows students to ask open-ended questions to gather occupational history, explore symptoms, and plan interventions.
After the learning task, all students complete a six-item written exam assessing their performance in the cognitive, affective, and psychomotor domains. Two independent raters, blinded to group assignment, evaluate student responses using a predefined rubric. Inter-rater reliability is calculated. To account for possible differences in baseline academic performance, Grade Point Average (GPA) is used as a covariate in the statistical analysis.
The study also includes a qualitative component in which students in the Chatbot Group submit the queries they posed during the interaction. These queries are analyzed inductively using a content analysis approach to explore how students engage with AI support-whether for conceptual clarification, procedural guidance, or ethical reasoning.
This research addresses a growing interest in how AI-based tools may enhance, supplement, or potentially limit professional training in occupational therapy. Although AI chatbots may offer convenient access to information and support student creativity, concerns remain about their effectiveness in fostering reflective and ethical clinical reasoning. By analyzing both performance data and interaction patterns, this study aims to offer evidence-based insights into the role of digital tools in OT education.
研究设计
- 研究类型
- Interventional
- 分配方式
- Randomized
- 干预模型
- Parallel
- 主要目的
- Other
- 盲法
- Single (Outcomes Assessor)
盲法说明
The outcome assessors who scored the written exam were blinded to group assignment. Participants and investigators were not masked due to the nature of the educational intervention.
入排标准
- 年龄范围
- 20 Years 至 23 Years（Adult）
- 性别
- All
- 接受健康志愿者
- 是
入选标准
- •Currently enrolled as an undergraduate student in an occupational therapy program
- •Registered in the "Neurological Rehabilitation" course during the study semester
- •Aged between 20 and 23 years
- •Provided written informed consent to participate in the study
排除标准
- •Previously completed the "Neurological Rehabilitation" course in a prior semester
- •Refused or failed to provide informed consent
- •Participated in a similar case-based learning study within the past 6 months
研究组 & 干预措施
AI Chatbot-Assisted Case-Based Learning
Participants in this arm completed a Parkinson's disease case analysis using an AI chatbot designed to simulate interaction with a virtual client. The chatbot provided real-time, natural language responses to student queries. Students worked in small groups to develop problem lists, goals, and intervention plans based on the simulated interaction.
干预措施: AI Chatbot-Assisted Case-Based Learning (Behavioral)
Traditional Case-Based Learning
Participants in this arm completed the same Parkinson's disease case analysis using traditional learning resources, such as lecture notes and textbooks. They worked in small groups to develop problem lists, goals, and intervention plans without access to the AI chatbot or any digital simulation tool.
干预措施: Traditional Case-Based Learning with Standard Materials (Behavioral)
结局指标
主要结局
Total Post-Test Score (0-24 points)
时间窗: Immediately after the intervention (within the same session)
The total score on a six-item written examination measuring clinical reasoning performance in occupational therapy students. The test includes items covering cognitive, affective, and psychomotor domains. Each item is scored by two independent, blinded raters. The total possible score is 24 points. Higher scores indicate better clinical reasoning performance.
Total Post-Test Score (0-24 points)
时间窗: Immediately after the intervention (within the same session)
The total score on a six-item written examination measuring clinical reasoning performance in occupational therapy students. The test includes items covering cognitive, affective, and psychomotor domains. Each item is scored by two independent, blinded raters. The total possible score is 24 points. Higher scores indicate better clinical reasoning performance.
次要结局
- Cognitive Domain Score (0-8 points)(Immediately after the intervention)
- Affective Domain Score (0-8 points)(Immediately after the intervention)
- Psychomotor Domain Score (0-8 points)(Immediately after the intervention)
- Cognitive Domain Score (0-8 points)(Immediately after the intervention)
- Affective Domain Score (0-8 points)(Immediately after the intervention)
- Psychomotor Domain Score (0-8 points)(Immediately after the intervention)
研究者
Ceyhun Türkmen
Assoc. Prof.
Çankırı Karatekin University