Comparison of Three Modalities to Assess Clinical Competence of Medical Students
- Conditions
- Educational Problems
- Interventions
- Other: High-fidelity simulationOther: Simulation gameOther: Multiple choice questionnaire
- Registration Number
- NCT03884114
- Lead Sponsor
- Ilumens
- Brief Summary
This study, focusing on the management of pediatric asthma exacerbations, assesses the clinical skills of medical students using three different evaluation tools: (i) the simulation game "Effic'Asthme" developed to train individuals on the management of pediatric asthma exacerbations; (ii) a multiple choice questionnaire (MCQ) on the same subject developed for the purpose of the study and (iii) high fidelity (HF)-simulation, considered as the gold-standard for its enhanced realism.
Its objective is to determine which of the simulation game or the MCQ reflects the best the clinical competence of medical students evaluated on a HF simulator.
- Detailed Description
The assessment of medical students' clinical competence has long been of concern to educational institutions. Objective structural clinical examination (OSCE) and assessments in high-fidelity (HF) simulation settings represent interesting evaluation modalities but are associated with huge costs, especially when they are used for large-scale standardized assessments. Multiple choice questionnaires (MCQ) remain the most common evaluation tool in medical schools.
Simulation games may represent an interesting compromise between the cheap but limited assessment allowed by MCQs, and the comprehensive but highly expensive assessment allowed by OSCE and HF simulation.
This study, focusing on the management of pediatric asthma exacerbations, assesses the clinical skills of medical students using three different evaluation tools: (i) the simulation game "Effic'Asthme" developed to train individuals on the management of pediatric asthma exacerbations; (ii) a MCQ on the same subject developed for the purpose of the study and (iii) HF-simulation, considered as the gold-standard for its enhanced realism.
Its objective is to determine which of the simulation game or the MCQ reflects the best the clinical competence of medical students evaluated on a HF simulator.
Recruitment & Eligibility
- Status
- COMPLETED
- Sex
- All
- Target Recruitment
- 42
-
medical students from Paris 5 University who meet the following criteria
- Being in their fifth year of medical school
- Having passed their pediatric exam in the previous 15 days
- Willing to participate in the study
- refusal to participate
Study & Design
- Study Type
- INTERVENTIONAL
- Study Design
- SEQUENTIAL
- Arm && Interventions
Group Intervention Description All participants Simulation game All participants are evaluated on a scenario of pediatric asthma exacerbation using three different evaluation tools: (i) the simulation game EfficAsthme developed to train individuals on the management of pediatric asthma exacerbations; (ii) a MCQ on the same subject developed for the purpose of the study and (iii) HF-simulation, considered as the gold-standard for its enhanced realism. All participants Multiple choice questionnaire All participants are evaluated on a scenario of pediatric asthma exacerbation using three different evaluation tools: (i) the simulation game EfficAsthme developed to train individuals on the management of pediatric asthma exacerbations; (ii) a MCQ on the same subject developed for the purpose of the study and (iii) HF-simulation, considered as the gold-standard for its enhanced realism. All participants High-fidelity simulation All participants are evaluated on a scenario of pediatric asthma exacerbation using three different evaluation tools: (i) the simulation game EfficAsthme developed to train individuals on the management of pediatric asthma exacerbations; (ii) a MCQ on the same subject developed for the purpose of the study and (iii) HF-simulation, considered as the gold-standard for its enhanced realism.
- Primary Outcome Measures
Name Time Method Items of the "asthma exacerbation performance score" Baseline This score uses a scale designed for the purpose of the study, the "Asthma exacerbation performance score", ranging from 0 to 19, 19 being the highest rate meaning that all the actions were correctly performed (1 point per action correctly performed).
This score will allow to calculate the degree of correlation calculated by Kappa coefficient for each action performed or answer provided, between the simulation game and the high fidelity simulation session on the one hand; and between the multiple choice questionnaire and the high fidelity simulation session on the other hand;
Then, we will compare the median Kappa coefficients for each condition, and determine which of the multiple choice questionnaire or the simulation game reflects the best the clinical competence of medical students observed during a high-fidelity simulation session.
- Secondary Outcome Measures
Name Time Method The satisfaction of students using Likert-scales with each evaluation modality Baseline The satisfaction of students with the simulation game, and with the multiple choice questionnaire, will be assessed using a questionnaire with Likert-scales.
The total score on the "asthma exacerbation performance score" Baseline The total scores of this checklist will allow to calculate:
* the degree of correlation of the scores using this checklist between the simulation game and the high-fidelity simulation session using spearman correlation,
* the degree of correlation of the scores using this checklist between the simulation game and the multiple choice questionnaire using spearman correlation
It will also allow to compare the median scores of the students between the three modalities of assessment (high fidelity simulation, simulation game and multiple choice questionnaire), and the dispersion of the scores between the three modalities.
Trial Locations
- Locations (1)
Université Paris Descartes
🇫🇷Paris Cedex 06, France