Enhancing Engagement With Digital Mental Health Care
Overview
- Phase
- N/A
- Intervention
- Not specified
- Conditions
- Engagement, Patient
- Sponsor
- University of Washington
- Enrollment
- 78390
- Locations
- 3
- Primary Endpoint
- Study 1: Mental Health America Disengagement (After Stage 1 Randomization)
- Status
- Completed
- Last Updated
- 9 months ago
Overview
Brief Summary
This proposal is a partnership between Mental Health America (MHA), a nonprofit mental health advocacy and resource organization, Talkspace (TS), a for-profit, online digital psychotherapy organization, and the University of Washington's Schools of Medicine and Computer Science Engineering (UW). The purpose of this partnership is to create a digital mental health research platform leveraging MHA and TS's marketing platforms and consumer base to describe the characteristics of optimal engagement with digital mental health treatment, and to identify effective, personalized methods to enhance motivation to engage in digital mental health treatment in order to improve mental health outcomes. These aims will be met by identifying and following at least 100,000 MHA and TS consumers over the next 4 years, apply machine learning approaches to characterizing client engagement subtypes, and apply micro-randomized trials to study the effectiveness of motivational enhancement strategies and response to digital mental health treatment.
Detailed Description
Digital mental health (DMH) is the use of technology to improve population well-being through rapid disease detection, outcome measurement, and care. Although several randomized clinical trials have demonstrated that digital mental health tools are highly effective, most consumers do not sustain their use of these tools. The field currently lacks an understanding of DMH tool engagement, how engagement is associated with well-being, and what practices are effective at sustaining engagement. In this partnership between Mental Health America (MHA), Talkspace (TS), and the University of Washington (UW), the investigators propose a naturalistic and experimental, theory-driven program of research, with the aim of understanding 1) how consumer engagement in self-help and clinician assisted DMH varies and what engagement patterns exist, 2) the association between patterns of engagement and important consumer outcomes, and 3) the effectiveness of personalized strategies for optimal engagement with DMH treatment. This study will prospectively follow a large, naturalistic sample of MHA and TS consumers, and will apply machine learning, user-centered design strategies, and micro randomized and sequential multiple assignment randomized trials (SMART) to address these aims. As is usual practice for both platforms, consumers will complete online mental health screening and assessment, and the investigators will be able to classify participants by disease status and symptom severity. The sample that the investigators will be working with will not be limited by diagnosis or co-morbidities. Participants will enter the MHA and TS platforms prospectively over 4 years. For aim 1, participant data will be analyzed statistically to reveal differences in engagement and dropout across groups based on demographics, symptoms and platform activity. For aim 2, the investigators will use supervised machine learning techniques to identify subtypes based on consumer demographics, engagement patterns with DMH, reasons for disengagement, success of existing MHA and TS engagement strategies, and satisfaction with the DMH tools, that are predictive of future engagement patterns. Finally, based on the outcomes from aim 2, in aim 3a the investigators will conduct focus groups applying user centered design strategies to identify and co-build potentially effective engagement strategies for particular client subtypes. The investigators will then conduct a series of micro-randomized and SMART trials to determine which theory-driven engagement strategies, co-designed with users, have the greatest fit with subtypes developed under aim 2. The investigators will test the effectiveness of these strategies to 1) prevent disengagement from those who are more likely to have poor outcomes after disengagement, 2) improve movement from motivation to volition and, 3) enhance optimal dose of DMH engagement and consequently improve mental health outcomes. These data will be analyzed using longitudinal mixed effects models with effect coding to estimate the effectiveness of each strategy on client engagement behavior and mental health outcomes. The purpose of aim 3b is to identify effective engagement strategies tailored to client needs and demographics to increase MHA website engagement, and to better understand how self-help mental health resources can help people overcome negative thinking and support healthier thought processes. The investigators will compare effective engagement strategies tailored to subtypes developed under aim 2 to study the mediated impact of engagement strategies on consumer mental health outcomes. The study team will determine if engagement strategies targeted to consumer engagement subtype will enhance engagement and in turn result in improved clinical outcomes. These will be compared to generic strategies that are not subtype targeted. All aim 3b activities will occur with MHA, broken down into two parts: (Study 1) a sequential multiple assignment randomized trial (SMART) and (Study 2) a Do-It-Yourself (DIY) tool longitudinal randomized control trial (RCT). Study 1 will use a SMART to examine methods to optimize engagement with MHA's website, and Study 2 will recruit participants for a longitudinal month-long study where they are randomly assigned to a control group, the use of a DIY tool without Artificial Intelligence (AI), or the use of a DIY tool with AI to examine the efficacy of using a digital tool to improve mental health functioning. An AI tool that uses machine learning/Natural Language Processing (NLP)/AI methods was developed to personalize and tailor an intervention to improve engagement and completion outcomes. The study focuses on a specific, popular DIY tool that teaches cognitive restructuring. Pilot work showed that (1) engagement and completion rates on DIY tools can be low, and (2) a pilot AI tool had significantly higher engagement and completion rates. These differences may arise due to AI support, User Interface/User Experience/design differences, other factors, or a combination thereof. Additionally, the efficacy of the digital tool to improve mental health functioning is unknown. Study 2 will recruit participants who will be randomly assigned to one of three groups for a longitudinal month-long study: thrice-weekly DIY tool use with AI, without AI, or a control group.
Investigators
Tim Althoff
Assistant Professor, Computer Science and Engineering
University of Washington
Eligibility Criteria
Inclusion Criteria
- •Phase 3b Study 1 (Sequential Multiple Assignment Randomized Trial; SMART): Users of the Mental Health America (MHA) website, engaging from Internet Protocol (IP) addresses in the United States, who have chosen to start the PHQ-9 depression screener in English. Must be those who can read English.
- •Phase 3b Study 2 (Do-It-Yourself; DIY): Patient Health Questionnaire (PHQ)-9 or Generalized Anxiety Disorder (GAD)-7 score of 10 or greater, users of MHA website, 18 years of age or older.
Exclusion Criteria
- •Phase 3b Study 1 (SMART): None
- •Phase 3b Study 2 (DIY): Younger than 18 years old, Non-English or Non-Spanish speaking, PHQ-9 less than 10, outside of US, have more than a little familiarity with the concept of cognitive reframing.
Outcomes
Primary Outcomes
Study 1: Mental Health America Disengagement (After Stage 1 Randomization)
Time Frame: Through active web session, an average of 10 minutes
Proportion of users disengaging (i.e., by leaving the website; in contrast to clicking to view the screening results page or clicking another Mental Health America \[MHA\] link) after stage 1 randomization.
Study 1: Mental Health America Engagement, Clicks on Featured Resources (After Stage 2 Randomization)
Time Frame: Through active web session, an average of 10 minutes
Proportion of users clicking featured resources (i.e., links to webpages on Mental Health America, featured below screening results) from the screening results page.
Study 1: Mental Health America Engagement, Number of Webpages Clicked (After Stage 2 Randomization)
Time Frame: Through active web session, an average of 10 minutes
Number of webpages clicked (including links to either featured and non-featured resources) after stage 2 randomization.
Study 1: Mental Health America Disengagement (After Stage 2 Randomization)
Time Frame: Through active web session, an average of 10 minutes
Proportion of users disengaging (i.e., by leaving the website; in contrast to clicking a link to a Mental Health America \[MHA\] webpage) after stage 2 randomization.
Study 1: DIY Completion Rate (After Stage 2 Randomization)
Time Frame: Through active web session, an average of 10 minutes
Number of participants who completed the Do-It-Yourself (DIY) tool.
Study 2: Engagement (Dosage)
Time Frame: Week 1, Week 2, Week 3, Week 4
Number of times using the Do-It-Yourself (DIY) tool
Study 2: Tool Use Helpfulness
Time Frame: Week 1, Week 2, Week 3, Week 4
Tool Use Helpfulness is measured using one item (Using the tool has been helpful to me in dealing with my negative thoughts and emotions) on a scale of 0 (strongly disagree) to 3 (strongly agree). Higher scores indicate better outcomes (helpfulness of the tool). Scores will be assessed using mean item-level scores. Note: includes 5 qualitative questions, not included here.
Study 2: Emotion Mechanisms
Time Frame: Week 1, Week 2, Week 3, Week 4, Week 8
Emotion mechanisms are measured using a 7-item scale. Each item is scored from 1 to 7. Total scores range from 7 to 49. Higher scores indicate better emotion mechanisms. Participants are asked about their emotions (e.g., hopefulness, worry, confidence, motivation) about their ability to address negative thoughts. Scores will be assessed using mean item-level and total scores. Item 1: How hopeful do you feel about the future? Item 2: How hopeful do you feel about managing negative thoughts? Item 3: How worried do you feel about managing negative thoughts? (reverse-coded) Item 4: How motivated are you to keep working on managing negative thinking? Item 5: How confident are you in your ability to identify thinking traps? Item 6: How confident are you in your ability to reframe negative thoughts? Item 7: How likely are you to recommend it to a friend?
Study 2: Tool Mechanisms
Time Frame: Week 1, Week 2, Week 3, Week 4
Tool Mechanisms is measured using 4 items about reframing. The items measure relatability/believability, helpfulness, memorability, and learnability on a scale of 1 (strongly disagree) to 5 (strongly agree). Total scores range from 4 to 20, with higher scores indicating better outcomes after using a Do-It-Yourself (DIY) tool. Scores will be assessed using mean item-level and total scores. Item 1: I believe in the reframe I came up with; Item 2: The reframe helped me deal with the thought I was struggling with; Item 3: I will remember this reframe the next time I experience this thought; Item 4: By doing this activity, I learned how I can deal with future negative thoughts
Study 2: Tool Mechanisms (Part 2)
Time Frame: Week 1, Week 2, Week 3, Week 4
Tool Mechanisms (Part 2) is measured using 2 items about belief change and emotion change on a scale of -7 to 7. Total scores range from -14 to 14, with higher scores indicating stronger beliefs and emotions after completing a DIY tool. Note: this also includes 1 qualitative question; not included here. Scores will be assessed using mean item-level and total scores. Item 1: After doing this activity, how strongly do you believe in your original thought? Item 2: After doing this activity, how strong is your emotion?
Study 2: DIY Skill Use: Competencies of Cognitive Therapy Scale - Self-Report
Time Frame: Week 1, Week 2, Week 3, Week 4, Week 8
The Competencies of Cognitive Therapy Scale will be used to ask participants about how much they have used specific strategies to cope with negative moods, primarily negative automatic thoughts, in the last 4 weeks. The current study will use items 20, 28, 21, 6, 24, and 11. Items are rated from 1 (not at all) to 7 (completely). Total scores range from 6 to 42. Higher scores indicate better outcomes. Scores will be assessed using mean item-level and total scores. Note: also includes 3 qualitative questions; not included here. Themes: Item 20: re-evaluating the situation; Item 28: taking time to step back and considering that negative thoughts might be inaccurate; Item 21: actively working to develop more rational views; Item 6: having a specific action plan of things they could do to cope; Item 24: taking time to consider other factors that may have been involved; Item 11: taking note of what they were thinking and working to develop a more balanced view
Long-term Adoption of the Intervention
Time Frame: Week 5
We measure long-term adoption of the Intervention using an 8-item scale assessing attitudes and behaviors related to engaging with and adopting a mental health intervention focused on reframing negative thoughts. Each item is scored on a scale from 1 to 10. Higher scores indicate greater comfort, likelihood, willingness, excitement, or impact, depending on the item. Specifically, the items assess comfort with attending therapy (Item 1), working with a therapist on reframing (Item 2), and discussing negative thoughts (Item 3); likelihood of seeking mental health information (Item 4); willingness to commit to practicing reframing (Item 5); excitement about learning a new mental health skill (Item 6); the impact of negative thoughts on life (Item 7); and likelihood of recommending the intervention to a friend (Item 8). Scores will be assessed using mean item-level scores. No statistical analysis conducted.
Hopefulness
Time Frame: Week 1, Week 2, Week 3, Week 4, Week 8
Hopefulness is measured using a single item (How hopeful do you feel about the future?). Scores will be assessed using mean item-level scores. Scores range from 1 to 7, with higher scores indicating better outcomes (more hopefulness). No statistical analysis (this item was merged with emotion mechanisms).
Secondary Outcomes
- Study 2: Generalized Anxiety Disorder-7 (GAD-7)(Baseline, Week 1, Week 2, Week 3, Week 4, Week 8)
- Study 2: Patient Health Questionnaire-9 (PHQ-9)(Baseline, Week 1, Week 2, Week 3, Week 4, Week 8)