AI-generated Feedback in Social Robotic Virtual Patients
试验速览
- 阶段
- 不适用
- 状态
- 已完成
- 发起方
- 入组人数
- 115
- 试验地点
- 2
- 主要终点
- Total OSCE score
研究概览
简要总结
The goal of this quasi-experimental educational study is to learn whether AI-generated post-consultation feedback in social robotic virtual patient interactions improves medical students' clinical performance in medical history-taking. The main question it aims to answer is:
Can AI-generated feedback integrated in an AI-enhanced social robotic virtual patient platform improve medical students' clinical performance in medical history taking?
Researchers will compare results from standardised examinations following the structure of an objective structured clinical examination (OSCE), of medical students performing virtual patient interactions with AI-generated post consultation feedback compared to medical students who have not received AI-generated feedback.
Participants will perform five virtual patient cases in rheumatology using an established virtual patient platform: the Social AI-enhanced Robotic Interface (SARI). After completion of each case, students participate in follow-up seminars with consultant rheumatologists to discuss the cases. After completion of all nine cases, students take part in a OSCE based examination to evaluate medical-history taking.
详细描述
The overarching aim of this project is to investigate if a system for direct feedback incorporated in an AI-empowered social robotic VP platform be more effective in the training of CR and communication skills for medical students than the same AI-empowered social robotic VP platform with no feedback system?
Higher knowledge within this research field contributes to optimised usage of new technology alongside other educational resources to facilitate meaningful learning outcomes, including supervision and patient encounters. The short- and long-term aim is to improve the medical education environment to ensure better healthcare for patients living with rheumatic conditions, while being applicable to other medical disciplines as well. While it still undergoes refinements, this educational activity provides students with the opportunity to train in a safe and interactive environment.
Background:
In healthcare today, most services are provided at outpatient clinics and daycare wards, being also the case within rheumatology. However, a significant portion of undergraduate healthcare professions education (HPE) continues to take place in inpatient settings, where ensuring that hospitalised patients align with specific learning outcomes remains a challenge. The patients requiring hospital admission typically have longstanding conditions, often presenting with complex disease manifestations and complications, alongside substantial medical comorbidities. The COVID-19 pandemic highlighted additional barriers for students to engage with teachers, patients and peers. This situation, combined with previous proposals for alternative approaches toward theoretical and practical skills training in undergraduate HPE, emphasises the pressing need for innovative learning activities that facilitate meaningful interactions between students and patient cases that are represented in HPE curricula.
Virtual patients (VP) are interactive digital simulations of clinical scenarios designed for educational purposes and are represented through a variety of systems and approaches. A fundamental component of VP simulations is their interactive interface, which enables users to engage with patients in a variety of ways: gathering medical history, conducting physical examinations, and implementing investigative strategies. These comprehensive possibilities of interaction allows users to collect essential information to perform diagnostics and decide upon appropriate management plans for their VPs.
研究设计
- 研究类型
- Interventional
- 分配方式
- Non Randomized
- 干预模型
- Parallel
- 主要目的
- Other
- 盲法
- Double (Investigator, Outcomes Assessor)
盲法说明
Medical students/participants will know if they are part of intervention or control arm. Outcome assessors will be blinded to participant conditions during OSCE based examinations.
入排标准
- 性别
- All
- 接受健康志愿者
- 否
入选标准
- •Sixth-semester medical students at Karolinska Institutet.
- •Assigned to clinical rotations in rheumatology.
- •Participating between January and June 2025.
排除标准
- 未提供
结局指标
主要结局
Total OSCE score
时间窗: Enrollment and evaluation during the same week during a period of 1.5 working days. Evaluation was done following completion of all virtual patient cases at the end of Day 2 of the Virtual Outpatient Clinic.
Immediately after completing the virtual outpatient clinic, participating students underwent an OSCE-like evaluation designed to assess performance in medical history-taking and clinical reasoning. The eight-minute evaluation involved interaction with a standardised patient. Performance was assessed by a consultant rheumatologist using a validated rubric, with the assessor blinded to whether students had received feedback. The assessment used a ten-point scale across five domains: communication at consultation start (0-3 points), generic medical history (0-3.5 points), targeted medical history (0-1.5 points), diagnostics and management reasoning (0-1 point), and communication at consultation end (0-1 point).
次要结局
- Pass rate comparisons(Enrollment and evaluation during the same week during a period of 1.5 working days. Evaluation was done following completion of all virtual patient cases at the end of Day 2 of the Virtual Outpatient Clinic.)
- Individual OSCE domain comparisons(Enrollment and evaluation during the same week during a period of 1.5 working days. Evaluation was done following completion of all virtual patient cases at the end of Day 2 of the Virtual Outpatient Clinic.)
研究者
Ioannis Parodis
MD, PhD
Karolinska Institutet
