A MULTICENTER STUDY TO OPTIMIZE MICROEMBOLIC SIGNAL CLASSIFICATION BASED ON DOUBLE-BLIND MULTIPARAMETRIC ASSESSMENT BY HUMAN EXPERTS USING AN UNIVERSAL GRAPHICAL INTERFACE [MESOMEGA]
- Conditions
- MicroemboliStrokeTranscranial Doppler Ultrasound
- Registration Number
- NCT07172165
- Lead Sponsor
- Universidade do Porto
- Brief Summary
Microembolic signals (MES) is a powerful predictor of future embolic events. This study aims to develop and validate a accurate model of classification of MES obtained by transcranial Doppler. monitoring of However, MES detection is technically demanding and requires expert interpretation. By providing a reproducible framework for MES interpretation, this work aims to facilitate MES integration into future clinical trials and decision-making.
- Detailed Description
Rationale
The presence of microembolic signals (MES) is a powerful predictor of future embolic events. However, MES detection is technically demanding and requires expert interpretation.
Aim We aim to develop and validate a supervised prediction model for MES classification using features extracted from transcranial Doppler (TCD) signals. The model is intended to support expert consensus and enhance classification concordance by utilizing standardized, pre-specified signal features.
Sample size estimates Sample size was estimated using the pmsampsize R package. Based on five predictors, a 1:1 proportion of MES in final dataset, a maximum Nagelkerke R² of 0.75, a shrinkage factor of 90% (to minimize overfitting), and a mean absolute error in predicted probabilities ≤ 0.05, the required sample size is 850 clips. The calculations included an 80:20 training/testing split and a 10% dropout rate.
Methods and Design The "Multicenter Study to Optimize Microembolic Signal Classification Based on Double-blind Multiparametric Assessment by Human Experts Using a Universal Graphical Interface" (MESOMEGA trial) is a prospective, randomized, double-blind, diagnostic validation study. All members of World Organization of Neurosonology, their national affiliated societies, and worldwide TCD users in the medical community will be invited to submit TCD monitoring 20-second clips of presumed solid MES or non-MES high-intensity transient signals recorded using a 2 MHz transducer from the proximal middle cerebral artery. Exclusion criteria include inseparable multiple MES (e.g., curtain) or any gaseous embolic form. Each clip will be independently assessed by two randomly allocated experts. Expert reading will be using TCDPlayer and will be blinded to clinical data, source information, and other assessments. They will manually annotate six predefined signal features: characteristic audible signal increase, characteristic wave-like of raw Doppler signals, Emboli-to-Background Ratio, Emboli-to-Mirror Ratio, signal duration, and average velocity of maximum intensity. Analysis will be completed within 90 days. A supervised decision tree model will be developed on the training dataset and validation set. Performance will be assessed using stratified k-fold cross-validation, reporting accuracy, sensitivity, specificity, and area under the receiver operating characteristic curve (AUC). Following model development, a Delphi consensus process will be used to evaluate and validate model outputs, aiming for expert agreement on model acceptability and readiness for clinical application. The study will be conducted under appropriate ethical approval and in accordance with international report standards. The study will be conducted under ethical guidelines and approval.
Study Outcomes The primary outcome is the classification of clips as MES or non-MES, using expert consensus as ground truth. The model will aim for ≥ 90% classification accuracy. Secondary outcomes include model performance without auditory parameter, interrater concordance and variability, and Delphi consensus strength.
Discussion This study will assess the performance of a supervised decision tree model for MES classification and benchmark it against prior MES detection approaches. By providing a reproducible framework for MES interpretation, this work aims to facilitate MES integration into future clinical trials and decision-making.
Recruitment & Eligibility
- Status
- ENROLLING_BY_INVITATION
- Sex
- All
- Target Recruitment
- 850
MES of presumed solid form or non-MES high intensity transient signals
Obtained from on a human subject with age equal to or more than 18years old
Obtained from proximal middle cerebral artery (M1 segment)
Clip with 20 seconds duration with clearly event of interest marked using TCDPlayer
With an overall background spectrum of reasonable quality to be analyzed
MES in gaseous form
Use of ultrasound contrast agent or agitated saline in the previous 24 hours
Obtained from patients with mechanical valve
Obtained from patient during any cardiac surgery or endovascular procedure1
Obtained from patient with recent severe trauma
Clips with multiples inseparable MES (e.g. curtain)
Study & Design
- Study Type
- OBSERVATIONAL
- Study Design
- Not specified
- Primary Outcome Measures
Name Time Method Classification of each signal as MES or Non-MES From enrollment until December of 2026 A MES or non-MES will be considered as such the two experts agree. If the two experts do not agree, a special board (RA, WM) will decide on classification. "Recordings that remain undetermined, or those classified as undetermined by both experts, will be excluded from the primary analysis of this study. All experts will be blinded to each other, any identification tag or clinical information. We will include five predictors in the primary analysis which are: the presence of characteristic audible signal increase, characteristic wave-like raw Doppler signals, the Emboli-to-Background Ratio (EBR), Emboli-to-mirror-ratio (EMR), time length and average velocity of maximum intensity. The calculation and definition of each predictor is detailed in table 3 and in supplemental information (Proposal for a systematic analysis and reporting of microembolic signal detection of the Microembolic Signal Detection Working Groups of the World Organization of Neurosonology).
- Secondary Outcome Measures
Name Time Method Trimmed version of the model From enrollment until December of 2026 To compare the model performance with and without auditory parameter To compare the subgroups of exclude MES vs non-MES how model performance
Model with extra-features From enrollment until December of 2026 To compare the model performance with and without a derived Embolus Distance parameter as calculated by the formula: Embolus Distance (mm) = Time length x average velocity of maximum intensity
Inter-expert variability in feature extraction. From enrollment until December of 2026 Delphi process From enrollment until December of 2026 Strength of the Delphi process
Trial Locations
- Locations (1)
Faculty of Medicine University Porto
🇵🇹Porto, Portugal
Faculty of Medicine University Porto🇵🇹Porto, Portugal