Human-AI Collaboration for Ultrasound Diagnosis of Thyroid Nodules - a Clinical Trial

This is a prospective clinical study aiming to test how the experience of the ultrasound operator influences the performance of AI-based (artificial intelligence-based) diagnostics when analysing thyroid nodules on ultrasound scans. The investigators set up an experiment with five stations, each with a patient with a thyroid nodule and an ultrasound machine with the deep learning based system S-Detect for Thyroid installed. 20 study participants where recruited: 8 medical students of novice ultrasound skill, 3 junior ENT (ear-nose-throat) registrars of intermediate ultrasound skill, and 9 senior ENT registrars experienced in ultrasound. The participants scanned all the patients and recorded their analyses of the nodules using the EUTIRADS (European thyroid imagining reporting and data system) system in three different ways: a analysis of their own, S-Detect's analysis, and an analysis combining the two previous.

The hypothesis was that the AI system would perform equally well when between the participant groups. In addition, it was expected that the experienced participants would perform better than the students without AI help, and that the doctors would gain little from AI input, but that the students would have their performance improved by AI input.