Investigating How Incentives Impact Engagement With an Online Mental Health Application (Neuroflow)

Not Applicable

Completed

• Conditions: Behavioral Economics; Gifts, Financial; Point

• Registration Number: NCT05121675
• Lead Sponsor: University of Pennsylvania

Brief Summary

The purpose of the study is to understand how incentives (either points alone or points that can be exchanged for gift certificates) encourage engagement with an online mental health app (Neuroflow) for University students. Overall, the hope of this study is to help the investigators understand how best to support mental health and wellness in university students.

Detailed Description

As mental health awareness and intervention has gained more traction throughout the years, applications - such as NeuroFlow - have emerged in an effort to facilitate aid to those who are unable to afford or access alternative mental health care methods. However, over 95% of mental health and wellness applications have not actually been studied. Additionally, a large portion examines user adoption of various mental health applications based on different factors, leaving a gap in research regarding client engagement and interest post-installation. Thus, despite promises, applications for promoting mental health often do not achieve their intended goals due to lack of sufficient client engagement/interest. In order to address this discrepancy, the use of financial incentives and other incentives from the field of behavioral economics may help. As an application, NeuroFlow embeds behavioral economic principles to increase motivation and engagement with the application (such as personalized pop-up notification reminders and app gamification including points accrual for activity completion and celebratory messages for meeting points thresholds) and also provides financial incentives whereby points accrued can be redeemed into gift cards for popular outlets such as Amazon. However, it is not clear if this financial incentive increases engagement or has knock-on effects for mental health and wellbeing over and above the behavioral economics incentives per se. In this study, the investigators will conduct a pilot two-arm randomized controlled trial where the investigators will examine the effect of a treatment group (NeuroFlow app with behavioral economics and financial incentives vs. NeuroFlow app with behavioral economics incentives only) on application engagement and mental health and wellbeing (anxiety and depression symptoms, sleep, self-regulation and wellbeing). The purpose of this study is to gain an understanding of how incentives encourage participation and engagement with an online mental health platform, NeuroFlow.

This study is a two-arm pilot randomized controlled trial to assess differences in user retention and usage rates associated with two incentive structures within the NeuroFlow app (I.e., general structure versus financial compensation). The investigators will assess user engagement with utilization data (ie., daily, weekly, and monthly active users) and measures of the total number of activity counts completed by a user. After consenting to participate in the study, participants will be randomly assigned to use Neuroflow either with points only or with points and the opportunity to exchange those points for gift cards. In both conditions, participants will begin by completing a consent form and a brief questionnaire with their contact information, which will be used to grant them access to the Neuroflow platform.

In both recruitment methods, participants will be required to sign up for a 15 minute check in and check out meeting before and after the trial to answer participant questions regarding the app/app set up or concerns about the consent form. Furthermore, a Qualtrics survey will also be dispersed to participants to be taken during this time along with an initial baseline assessment (to be administered in the NeuroFlow app).

Baseline and post-app usage Qualtrics survey links will also be sent with measures (Generalized anxiety disorder (GAD), Patient Health Questionnaire (PHQ), World Health Organization- Five Well-Being Index (WHO-5), and Difficulties in Emotion Regulation Scale (DERS)) to participants in order to assess differences in user retention.

In both conditions, participants will use the Neuroflow app throughout the duration of the 4-week study (28 days). Participants will be sent a push notification each day through the app to complete their daily activities, which could include surveys, videos, or skill-based practice materials.

With the collaboration of the Neuroflow team, the usage metrics of the app will be pulled after the end of the study. The user metrics of interest are identifying factors that include first name, last name, gender, age, date of birth, and the applicable assignments to each participant - care team manager and behavioral health specialist. Additionally, the first and last score, first and last date, and time between the first and last assessment dates for the measures of interest (PHQ-9, GAD-7, WHO-5, DERS). Furthermore, the total activity number and the total activity rate across all measures will be collected. No additional data from or about participant phone usage or activities will be pulled as part of the study other than the usage metrics specified above, specific to Neuroflow.

Basic Information
|
Recruitment & Eligibility
|
Study & Design
|
Trial Locations

Study Timeline

• Study First Submitted: 2021-11-02
• Study First Submitted QC: 2021-11-02
• Study Start: 2021-11-15
• Study First Posted: 2021-11-16
• Primary Completion: 2022-04-15
• Study Completion: 2022-05-15
• Results First Submitted: 2022-06-30
• Status Verified: 2024-08
• Results First Submitted QC: 2024-08-08
• Last Update Submitted: 2024-08-08
• Results First Posted: 2024-08-12
• Last Update Posted: 2024-08-12

Recruitment & Eligibility

• Status: COMPLETED
• Sex: All
• Target Recruitment: 107

Inclusion Criteria

• The target population for this study are college students either at the University of Pennsylvania or other US universities. Participants will be included if they have a smartphone and are willing to download and use the Neuroflow app throughout the duration of the study

Read More

Exclusion Criteria

• Does not own a smartphone capable of downloading the NeuroFlow application or is unwilling to download and use the Neuroflow app throughout the duration of the study.

Read More

Study & Design

• Study Type: INTERVENTIONAL
• Study Design: PARALLEL

Primary Outcome Measures

Name	Time	Method
Engagement (Percentage of Daily check-in Activities)	Throughout 28-day trial (averaged)	User engagement will be measured as the percentage of daily check-in activities (number completed out of the total number of activities assigned)

Secondary Outcome Measures

Name	Time	Method
Generalized Anxiety Disorder (GAD-7)	Baseline and post-trial, up to 28 days	Change from pre-trial to post-trial score in anxiety. Scores range from 0 to 21. Higher scores = higher symptoms of anxiety.
Patient Health Questionnaire (PHQ-8)	Baseline and post-trial, up to 28 days	Change from pre-trial to post-trial score in depression. Scores range from 0-24. Higher scores = higher symptoms of depression.
World Health Organization (WHO-5)	Baseline and post-trial, up to 28 days	Change from pre-trial to post-trial score in wellbeing. Scores range from 0-100 (raw score is multiplied by 4). Higher scores = higher wellbeing.
Difficulties Emotion Regulation Scale (DERS)	Baseline and post-trial, up to 28 days	Change from pre-trial to post-trial score in emotion regulation difficulties. Scores range from 36-180. Higher scores = greater problems with emotion regulation.

Trial Locations

Locations (1)

University of Pennsylvania; 🇺🇸 Philadelphia, Pennsylvania, United States