Using Surveys to Examine the Association of Exposure to ML Mortality Risk Predictions With Medical Oncologists' Prognostic Accuracy and Decision-making
- Conditions
- Oncology
- Interventions
- Other: Survey
- Registration Number
- NCT06463977
- Lead Sponsor
- Abramson Cancer Center at Penn Medicine
- Brief Summary
Nearly half of cancer patients in the US will receive care that is inconsistent with their wishes prior to death. Early advanced care planning (ACP) and palliative care improve goal-concordant care and symptoms and reduce unnecessary utilization. A promising strategy to increase ACP and palliative care is to identify patients at risk of mortality earlier in the disease course in order to target these services. Machine learning (ML) algorithms have been used in various industries, including medicine, to accurately predict risk of adverse outcomes and direct earlier resources. "Human-machine collaborations" - systems that leverage both ML and human intuition - have been shown to improve predictions and decision-making in various situations, but it is not known whether human-machine collaborations can improve prognostic accuracy and lead to greater and earlier ACP and palliative care. In this study, we contacted a national sample of medical oncologists and invited them complete a vignette-based survey. Our goal was to examine the association of exposure to ML mortality risk predictions with clinicians' prognostic accuracy and decision-making. We presented a series of six vignettes describing three clinical scenarios specific to a patient with advanced non-small cell lung cancer (aNSCLC) that differ by age, gender, performance status, smoking history, extent of disease, symptoms and molecular status. We will use these vignette-based surveys to examine the association of exposure to ML mortality risk predictions with medical oncologists' prognostic accuracy and decision-making.
- Detailed Description
Not available
Recruitment & Eligibility
- Status
- COMPLETED
- Sex
- All
- Target Recruitment
- 52
- Medical oncologists who treat lung cancer
- Medical oncologists who do not see lung cancer patients
Study & Design
- Study Type
- OBSERVATIONAL
- Study Design
- Not specified
- Arm && Interventions
Group Intervention Description 1A 2C 3B Survey 1. Intermediate; 1.A. Reference dependent; 2. Poor; 2.C. Both; 3. Good; 3.B. Absolute prognosis 1C 2B 3A Survey 1. Intermediate; 1.C. Both; 2. Poor; 2.B. Absolute; 3. Good; 3.A. Reference dependent 1A 2B 3C Survey 1. Intermediate; 1.A. Reference dependent; 2. Poor; 2.B. Absolute prognosis; 3. Good; 3.C. Both 1C 2A 3B Survey 1. Intermediate; 1.C. Both; 2. Poor; 2.A. Reference dependent; 3. Good; 3.B. Absolute 1B 2A 3C Survey 1. Intermediate; 1.B. Absolute; 2. Poor; 2.A. Reference dependent; 3. Good; 3.C. Both 1B 2C 3A Survey 1. Intermediate; 1.B. Absolute; 2. Poor; 2.C. Both; 3. Good; 3.A. Reference dependent
- Primary Outcome Measures
Name Time Method Prognostic accuracy as assessed via survey Up to 3 months Prognostic estimates were measured using two items administered after Parts 1 and 2 of each of the 3 vignettes:
1. What is your anticipated life expectancy for this patient, in months?
2. What do you think is the likelihood that she will die within 12 months? Please provide a percentage on a scale of 0% to 100%.
Accurate prognoses were defined as whether the reported life expectancy estimate was within 33% of the LCPI estimate, as modified after the focus groups. Participants answered the first question in months and the second question as a percentage between 0-100%.
- Secondary Outcome Measures
Name Time Method Advance care planning decisions as assessed via survey Up to 3 months ACP decision-making was assessed using the following item administered after Parts 1 and 2 of each of the 3 vignettes:
1) Would you have a discussion about advance care planning at this point in her disease course?
Each question was operationalized as a Yes/No answer and was followed by a free response box asking, "Please share your reason for this decision."Palliative care referral as assessed via survey Up to 3 months Palliative care referral was assessed using the following item administered after Parts 1 and 2 of each of the 3 vignettes:
1) Would you refer him/her to a palliative care specialist at this point in her disease course?
Each question was operationalized as a Yes/No answer and was followed by a free response box asking, "Please share your reason for this decision."
Trial Locations
- Locations (1)
Abramson Cancer Center of the University of Pennsylvania
🇺🇸Philadelphia, Pennsylvania, United States