Participatory Design of Electronic Health Record Tools for Problem Solving Therapy

Not Applicable

Completed

Conditions: Depression

Interventions: Behavioral: Assisted Problem Solving Therapy
Behavioral: Problem Solving Therapy as Usual

Registration Number: NCT03516513

Lead Sponsor: University of Washington

Brief Summary: Problem Solving Therapy for Primary Care (PST-PC) is an evidence based psychosocial intervention (EBPI) for use in primary care settings, with more than 100 clinical trials.

Despite its proven efficacy we have found that implementation of PST-PC is complicated, resulting in rapid program drift (deviation from protocol with associated loss of efficacy), among practitioners following completion of training. Many studied have shown that program drift is not uncommon in the implementation of EBPIs and can be mitigated through on-going decision support and supervision. Unfortunately, decision support and supervisors of EBPIs are not widely available in low-resourced primary care clinics. We will address this problem by creating decision support tools to be integrated into electronic health records. Because these tools are deemed by many practitioners in other fields to be burdensome, we will explicitly involve active input on the content, design and function of these support tools. Outcomes may include electronic dashboards for panel management, automated suggestions for application of PST-PC elements based on patient reported outcomes or integration of automated patient tracking, and support of patient engagement. We hypothesize that enhanced decision support (target mechanism) will sustain quality delivery of PST-PC, which in turn will improve patient reported outcomes.

Detailed Description: Specific aims. Although evidence-based psychosocial interventions (EBPIs) are a preferred treatment option by vulnerable populations, they are rarely available in community primary care settings and when available, are often delivered with poor fidelity. High quality delivery of evidence-based psychosocial interventions (EBPIs) in primary care medicine is a function of many variables, including clinician training and usability of the intervention. Several studies find that for EBPIs to be delivered with sustained quality, on-going supervision and guidance is critical (this study's focus). While the availability of clinicians trained in EBPIs is scarce, the availability to supervisors trained in EBPIs is even more limited. Given the ubiquity of electronic health records, automated decision support tools and feedback systems have been found to be effective in supporting sustained quality EBPIs, but in practice have had mixed success on outcomes such that they may actually hinder clinical care and are often ignored by clinicians. In a report by the Agency for Healthcare Research and Quality, a significant barrier to the use of decision support tools is that these tools have not been developed with input from the clinician or in consideration of their work environment. Using the Center's Discover, Design, Build, Test (DDBT) framework, we will work with clinicians from 13 Behavioral Health Integration Program (BHIP) sites to create a clinical decision tool that addresses the common decisional dilemmas clinicians face when implementing EBPIs. We hypothesize that creating tools to support EBPIs will result in improved clinician competency and sustained skill (target) to EBPIs, compared to clinicians without these supports, resulting in better patient outcomes . The specific aims of this study are:

Aim 1: Discover Phase (6 months). Using Participant Action research (PAR) informed user-centered design methods we will interview clinicians in primary care about challenges they face in the delivery of two EBPIs, Behavioral Activation and Problem Solving Treatment, observe them delivering these EBPIs, and receiving feedback on cases from experts in these EBPIs. This process will help us to identify the common decisional dilemma's clinician's face in delivering EBPIs, their preferences for expert guidance strategies, and how decision support tools could be embedded into clinic workflow to reduce obstacles and enhance the delivery of EBPIs.

Aim 2: Design/Build Phase (6 months). Based on information obtained in the discover phase, we will engage in a rapid cycle iterative prototype development and testing of decision support tools to support PST-PC, to be carried out using user-centered design (UCD). The build of these tools will include the development of prototypes for user testing and refinement with input from care managers across the 13 BHIP sites. Data from this phase will be used to inform the Matrix of EBPI Modifications.

Aim 3: Test Phase (18 months) In the second to third year of the proposed project we will test the decision support tools in a small pilot trial with six providers and thirty patients randomized to the use of the decision support tools. H1: Clinicians with access to decision tools will report better acceptability, usability, and less burden when using PST-PC than clinicians without the tools. H2: Clinicians randomized to decision support tools will more competently deliver EBPI elements than clinicians randomized to unsupported EBPI. H3: Patients treated by clinicians with access to decision tools will have better patient-reported outcomes than patients treated by clinicians without access to these tools as assessed with functional disability and change in depression symptoms over time .

Recruitment & Eligibility

Status: COMPLETED

Sex: All

Target Recruitment: 24

Inclusion Criteria

Clinicians: 18 years of age, able to read and speak English, provides psychotherapy as part of the University of Washington Medicine network, and willing to video-record PST sessions with patient participants Clients: 18+ years of age, able to read and speak English, willing to receive psychotherapy from a clinician who is also participating in the study, willing to have therapy sessions video-recorded, Patient Health Questionnaire-9 score of 10 or higher

Exclusion Criteria

Client: History or presence of psychiatric diagnoses other than unipolar, non-psychotic depression or generalized anxiety disorder

Study & Design

Study Type: INTERVENTIONAL

Study Design: PARALLEL

Arm && Interventions

Group	Intervention	Description
Assisted Problem Solving Therapy	Assisted Problem Solving Therapy	This arm will be designed and finalized in Phase 1 and 2 of the project. We anticipate that the intervention will leverage clinical notes required to be completed by clinicians and will provide information to clinicians to help patients improve over time, as well as help clinicians implement PST to high quality. Intervention: guided PST
Problem Solving Therapy as Usual	Problem Solving Therapy as Usual	Clinicians in this arm of care will have access to the Case Management Tracking System which is already in use. Intervention: unguided PST

Primary Outcome Measures

Name	Time	Method
Acceptability of Intervention Measure	Clinicians: Six months after certification in the intervention. Clients: Six week follow-up	The Acceptability of Intervention Measure is a four item measure of intervention acceptability, where each item is rated on a 1-5 scale, with 1 = not at all acceptable and 5 = very acceptable. Total scores depicted here are mean item scores and therefore the minimum and maximum values are 1 and 5. Higher scores mean more acceptable.
System Usability Scale	Clinicians: 6 month follow-up after certification in PST. Clients: Six week follow-up	The System Usability Scale is a 10-item scale with each item ranked on a five point system of low to high usability. Items are ranked from 1=strongly disagree to 5=strongly agree. The scale score is calculated by adding the item scores and multiplying the total by 2.5, with 0 being the least and 100 being the maximum. A score of 68 or better is considered to be above average usability. As score less than 68 is considered to be poor usability. In this study, a score of 80 or more is considered our cut off for high usability.
User Burden Scale	Clinicians: Six months follow-up after they have been certified in PST. Clients: six week follow-up timepoint	The User Burden Scale is a 20-item scale that assesses user burden when working with a system or technology. Each item is rated on a 0-4 scale, with a maximum score of 80 (high burden) and minimum score of 0 (low burden).

Secondary Outcome Measures

Name	Time	Method
Sheehan Disability Assessment Scale	Baseline, 6 week follow up	The Sheehan Disability Assessment Scale is 3-item self report measure of functioning, where each item is ranked on a scale of 1-10, with 1 = no disability and 10 =high disability, for a total scale score ranging from 0 to 30. Higher scores reflect greater disability.
Patient Health Questionnaire	Baseline, 6 week follow-up	The Patient Health Questionnaire is a 9 item self report measure of depression, where each item is rated on a scale of 0-3, for a total possible score of 0-27. Higher scores are indicative of more depressed mood, with scores over 10 considered to be clinically depressed.
Problem Solving Therapy Clinician Certification	Expert clinicians reviewed audiotapes of therapy sessions for each clinician participant over a six month period of time after initial training.	Problem Solving Therapy Clinician Certification was determined using the Problem Solving Therapy Adherence Scale, an observer-rated, 11 item scale, with each scale raking therapist competency in delivering the seen steps of PST using a 0 (not competent) to 5 (expert level) scale. Coders then use these item scores to rate a global fidelity rating on the same 0 to 5 scale. Receiving a 3 or higher on two sessions resulted in certification to practice PST. Therefore the outcome of importance is a dichotomous "certified/not certified". We report here on the number of clinicians in each group who certified.