AI-Generated Video Feedback to Improve Technical Skills in Coronary Artery Bypass Grafting
试验速览
- 阶段
- 不适用
- 状态
- 尚未招募
- 发起方
- 入组人数
- 100
- 试验地点
- 1
- 主要终点
- Change in Human Expert-Rated Technical Skill Score Between Baseline and Follow-Up CABG Videos
研究概览
简要总结
This study aims to evaluate whether targeted video feedback generated by an artificial intelligence (AI)-based surgical performance assessment model can support improvement in technical skills among cardiac surgeons performing coronary artery bypass grafting (CABG). This is a single-group, self-controlled, pre-post interventional study. Participating surgeons will submit a baseline CABG surgical video, which will be assessed by both an AI model and blinded human expert raters using standardized scoring criteria. Based on the AI assessment, surgeons will receive personalized video feedback highlighting operative steps associated with lower technical performance. After a one-month self-directed review period, a follow-up CABG surgical video will be submitted and evaluated using the same process. Changes in human-rated technical skill scores between baseline and follow-up will be used to assess the potential educational impact of AI-generated video feedback.
详细描述
Coronary artery bypass grafting (CABG) is a complex surgical procedure that requires a high level of technical skill from cardiac surgeons. Variability in surgical technique may influence procedural quality and patient outcomes. Recent advances in artificial intelligence (AI) have enabled automated assessment of surgical performance using operative video data, creating new opportunities for objective feedback and surgical education.
This study aims to evaluate whether targeted video feedback generated by an AI-based surgical performance assessment model can help cardiac surgeons improve their technical skills in CABG procedures. Participating surgeons whose baseline technical performance ranked in the lower half of the AI scoring system will receive personalized video feedback highlighting operative steps and maneuvers associated with lower performance scores.
In this single-group, self-controlled study, each participating surgeon will submit a baseline CABG surgical video, which will be independently evaluated by both the AI model and a panel of experienced cardiac surgeons using standardized scoring criteria. After receiving AI-generated video feedback, surgeons will be given one month to review and reflect on the feedback without additional formal training or coaching. A follow-up CABG surgical video will then be submitted and assessed using the same evaluation process.
The primary outcome of the study is the change in technical skill scores assigned by human expert raters between the baseline and follow-up videos. Secondary outcomes include surgeons' self-assessments of AI-identified performance deficits, agreement between AI-generated feedback and human expert feedback, and selected patient postoperative in-hospital outcomes. The findings of this study may inform the role of AI-assisted video feedback as a scalable educational tool for surgical skill development.
研究设计
- 研究类型
- Interventional
- 分配方式
- Na
- 干预模型
- Single Group
- 主要目的
- Other
- 盲法
- None
盲法说明
Human raters were blinded to surgeon identity and study phase.
入排标准
- 性别
- All
- 接受健康志愿者
- 是
入选标准
- •Baseline AI-assessed technical performance ranked in the lower 50% within the scoring system in CAMERA study (NCT06739005)
排除标准
- •Unwilling to attend
研究组 & 干预措施
AI-Guided Video Feedback Intervention
Participants in this study will receive a personalized educational intervention consisting of AI-generated video feedback based on their baseline coronary artery bypass grafting (CABG) surgical videos. The AI model analyzes surgical performance and identifies specific operative steps with lower technical skill scores. Curated video clips highlighting these areas are provided to the surgeons for self-review and reflection. No additional formal training or coaching is given during the one-month intervention period, after which a follow-up surgical video is submitted for re-evaluation.
干预措施: AI-Guided Video Feedback Intervention (Behavioral)
结局指标
主要结局
Change in Human Expert-Rated Technical Skill Score Between Baseline and Follow-Up CABG Videos
时间窗: Baseline, 1 month
The primary outcome is the change in technical skill scores assigned by a panel of blinded human expert raters, who independently evaluate anonymized coronary artery bypass grafting (CABG) surgical videos submitted at baseline and one month after receiving AI-generated video feedback. The scoring uses a standardized rubric to assess overall surgical technical performance. The higher score, the better performance: respect for tissue, time and motion, instrument handling, knowledge of instruments, use of assistants, flow of operation and forward planning, and knowledge of the specific procedure. Each domain was scored on a 5-point Likert scale, where 1 indicated poor performance and 5 represented excellence. In addition, each rater provided an overall impression score (1-5) to capture their holistic assessment of surgical performance. The two scores were scaled to 100 points and the final score consists of 70% of 7-domain rating sum scores and 30% of overall impression score.
次要结局
- Surgeon self-assessments of the AI feedback(1 month)
- Consistency between AI feedback and human expert feedback.(Baseline, 1 month)
- Postoperative in-hospital outcomes: the icidence of major complications(Baseline, 1 month)
- Postoperative in-hospital outcomes: the incidence of death(Baseline, 1 month)
- Postoperative in-hospital outcomes: the incidence of acute kidney injury(Baseline, 1 month)
- Postoperative in-hospital outcomes: the incidence of myocardial infarction(Baseline, 1 month)
- Postoperative in-hospital outcomes: the incidence of stroke(Baseline, 1 month)
- Postoperative in-hospital outcomes: the incidence of secondary thoracotomy(Baseline, 1 month)
- Postoperative in-hospital outcomes: the incidence of IABP implantation(Baseline, 1 month)
- Postoperative in-hospital outcomes: the incidence of ECMO implantation(Baseline, 1 month)
- Postoperative in-hospital outcomes: the incidence of bedside hemofiltration(Baseline, 1 month)
- Postoperative in-hospital outcomes: the incidence of peritoneal dialysis(Baseline, 1 month)
- Postoperative in-hospital outcomes: the incidence of tracheotomy(Baseline, 1 month)
研究者
Shengshou Hu
Prof
China National Center for Cardiovascular Diseases