Evaluation of a Remote Training Strategy
- Conditions
- Behavior Disorders
- Interventions
- Behavioral: Coping Power Program (CPP)Behavioral: CBT for Anxiety Treatment in Schools (CATS)Behavioral: Check-in/Check-out (CI/CO)Behavioral: Initial Training plus Video (RV)Behavioral: Initial Training (CC)Behavioral: Initial Training plus Video plus Coaching (RV+)
- Registration Number
- NCT05039164
- Lead Sponsor
- Children's Hospital of Philadelphia
- Brief Summary
An increasing number of schools in rural settings are employing the multi-tier positive behavioral interventions and supports (PBIS) framework to improve school-climate. PBIS can also be used as a framework for the adoption and integration of evidence-based practices (EBPs) for children's mental health concerns. A key challenge is that school personnel need technical assistance (training plus ongoing consultation) in order to implement EBPs with fidelity. In urban and suburban schools, this support can be provided to school staff on site. However, providing ongoing on-site support is not feasible or sustainable in the majority of rural schools, due to their remote physical location. For this reason, video technology has been recommended for the training of behavioral health staff (BHS) in under-served rural communities.
- Detailed Description
Objectives: The purpose of this study is to test the effectiveness of a remote training platform with BHS in schools serving rural communities.
Study Design: This study is a pilot randomized controlled trial to compare implementation and student outcomes of three training strategies: Control Condition (CC), Remote Video (RV), and Remote Video plus Coaching (RV+).
Setting/Participants: Participants will be school personnel with and without prior mental health training and students in grades 4-8 in schools serving rural communities who are deemed at risk for externalizing and internalizing mental health disorders. The pilot trial will be conducted in 24 schools (8 in CC, 8 in RV, and 8 in RV+). It is estimated that a total of 72 behavioral health staff (3 staff per school- 24 per arm) and 312 students (13 students per school - 104 per arm) will participate in this study. Additionally, we estimate about 24 school administrators such as principals or assistant principals will approve school's participation.
Study Interventions and Measures: Each school will be randomly assigned to receive one of three training supports: (a) Initial training (CC) (b) Initial training, plus video (RV) or (c) Initial training plus video, plus remote coaching (RV+). BHS in the RV+ condition will receive consultation from a Children's Hospital of Philadelphia (CHOP) consultant regarding implementation of EBPs, whereas BHS in the RV condition will be given access to the asynchronous training video modules. Participants in all three conditions will receive treatment manuals for the interventions they have chosen. The EBPs to be implemented by the BHS include: Coping Power Program (CPP), CBT for Anxiety Treatment in Schools (CATS), and Check-in/Check-out (CI/CO). All BHS will conduct one CPP or CATS group with 5 students of similar developmental level (e.g., a group of 4th \& 5th graders), and that each school staff in CI/CO will implement the intervention with 4 separate individual students of any eligible school grade.
Analyses: This study is designed to test the effectiveness of initial training compared to remote video training and remote video training plus coaching to train BHS to implement EBPs.
Recruitment & Eligibility
- Status
- ENROLLING_BY_INVITATION
- Sex
- All
- Target Recruitment
- 408
Administrator: Any school principal or assistant principal from participating schools implementing PBIS.
Behavioral Health Staff: Any counselor, social worker, or teacher from participating schools implementing PBIS who work with students in grades 4-8.
Students: Inclusion of students to receive a Tier 2 intervention is as follows:
- attending one of the participating schools
- being in grades 4-8
- identified by the Tier 2 team as not responding to Tier 1 intervention, thus needing Tier 2 support
- scoring ≥ 1 SD above the mean on the Emotional Symptoms or Conduct Problems scales of the Strength andDifficulties Questionnaire (SDQ) completed by a parent or a teacher
The cut-off score level for the SDQ is appropriate for identifying students at risk for a behavioral/mental health disorder. We limit participation to students in grades 4-8 because the group EBPs are appropriate for this age group.
Administrator: School staff who are not principals or assistant principals.
Behavioral Health Staff: School staff who are not part of the PBIS team and who do not work with students in grades 4-8.
Students: Students who do not meet screening or group participation criteria will not be included in the study. Students with a history of intellectual disability or serious developmental delays according to school records will not be included because they would be unlikely to benefit from the interventions used in the study. Students with a history of psychotic or autistic spectrum disorders as reported by parents will not be included.
Subjects that do not meet all the enrollment criteria may not be enrolled. Any violations of these criteria must be reported in accordance with the Institutional Review Board (IRB) Policies and Procedures.
Study & Design
- Study Type
- INTERVENTIONAL
- Study Design
- PARALLEL
- Arm && Interventions
Group Intervention Description Initial training plus video Initial Training plus Video (RV) School personnel will implement CATS or CPP and CICO with students in the school setting. They will participate in an initial live remote training and receive access to asynchronous video training modules about the EBPs (RV). Initial training Coping Power Program (CPP) School personnel will implement CATS or CPP and CICO with students in the school setting. They will participate in an initial live remote training to learn about implementing the three EBPs (CC). Initial training Check-in/Check-out (CI/CO) School personnel will implement CATS or CPP and CICO with students in the school setting. They will participate in an initial live remote training to learn about implementing the three EBPs (CC). Initial training plus video Check-in/Check-out (CI/CO) School personnel will implement CATS or CPP and CICO with students in the school setting. They will participate in an initial live remote training and receive access to asynchronous video training modules about the EBPs (RV). Initial training CBT for Anxiety Treatment in Schools (CATS) School personnel will implement CATS or CPP and CICO with students in the school setting. They will participate in an initial live remote training to learn about implementing the three EBPs (CC). Initial training plus video, plus coaching Check-in/Check-out (CI/CO) School personnel will implement CATS or CPP and CICO with students in the school setting. They will participate in an initial live remote training, receive access to asynchronous video training modules about the EBPs, and receive coaching support by study staff (RV+). The coaching will be from a study consultant regarding the implementation of EBPs. Initial training plus video, plus coaching CBT for Anxiety Treatment in Schools (CATS) School personnel will implement CATS or CPP and CICO with students in the school setting. They will participate in an initial live remote training, receive access to asynchronous video training modules about the EBPs, and receive coaching support by study staff (RV+). The coaching will be from a study consultant regarding the implementation of EBPs. Initial training Initial Training (CC) School personnel will implement CATS or CPP and CICO with students in the school setting. They will participate in an initial live remote training to learn about implementing the three EBPs (CC). Initial training plus video Coping Power Program (CPP) School personnel will implement CATS or CPP and CICO with students in the school setting. They will participate in an initial live remote training and receive access to asynchronous video training modules about the EBPs (RV). Initial training plus video, plus coaching Coping Power Program (CPP) School personnel will implement CATS or CPP and CICO with students in the school setting. They will participate in an initial live remote training, receive access to asynchronous video training modules about the EBPs, and receive coaching support by study staff (RV+). The coaching will be from a study consultant regarding the implementation of EBPs. Initial training plus video, plus coaching Initial Training plus Video plus Coaching (RV+) School personnel will implement CATS or CPP and CICO with students in the school setting. They will participate in an initial live remote training, receive access to asynchronous video training modules about the EBPs, and receive coaching support by study staff (RV+). The coaching will be from a study consultant regarding the implementation of EBPs. Initial training plus video CBT for Anxiety Treatment in Schools (CATS) School personnel will implement CATS or CPP and CICO with students in the school setting. They will participate in an initial live remote training and receive access to asynchronous video training modules about the EBPs (RV).
- Primary Outcome Measures
Name Time Method Changes in externalizing and internalizing problems Baseline and 14 weeks (post intervention) Student externalizing and internalizing problems will be measure by comparing student scores pre-intervention and post-intervention. The Behavior and Feeling Survey-Youth Report (YFS-SR) is a brief (10 items) measure of internalizing and externalizing problems rated on a 5-point scale. The YFS-SR has excellent psychometric properties, and it is sensitive to change. The YFS-SR provides three scores (Internalizing, Externalizing, Total).
Perceived adoption and penetration Up to 3 years Perceived adoption and penetration will be assessed via a survey completed by school staff. The adoption inventory will track the number of times each intervention is used per school, per condition. The penetration inventory will list EBP penetration at the student level (students receiving EBPs at Tier 2).
Changes in student mental health symptoms from Baseline to Post Intervention Baseline and 14 weeks (post intervention) Student Mental Health Symptoms will be measured by comparing parent scores pre-intervention and post-intervention. The Behavior Assessment System for Children-3rd edition (BASC-3) is a 138-item, 4-point, Likert-type rating scale (N=Never, S=Sometimes, O=Often, A=Almost Always) for assessing parental report of child mental health functioning, standardized for ages 2.5 to 18 years.
Measures of content fidelity for Check-in, Check-Out Up to 3 years Content fidelity for CI/CO will be assessed via the Check-In/Check-Out Fidelity Checklist. The CI/CO Fidelity Checklist is completed by the consultant (research staff) on a monthly basis after collecting the completed Daily Progress Report (DPR) student forms for each student involved in CICO.
Changes in academic engagement from Baseline to Post Intervention Baseline and 14 weeks (post intervention) Student Academic Engagement will be measured by comparing teacher scores pre-intervention and post-intervention. This is a 20-item, four-point instrument (1 = Not At All True, 2 = Not Very True, 3 = Sort Of True, 4 = Very True) with four sub-scales. Investigators will use the average score for each of the four scales at pre- and post-participation in group cognitive behavioral therapy (CBT) or Check-in/Check-out (CICO).
Measures of content fidelity for group cognitive-behavioral treatment (GCBT) Up to 3 years The primary endpoints related to school staff implementing the interventions are measures of content fidelity. Content fidelity for the group interventions CPP and CATS will be measured using the Content Fidelity Checklists that reflects each activity component of the session agenda of the treatment protocols. Raters use a yes/no response scale to indicate whether or not the implementer covered a particular component.
Measures of process fidelity Up to 3 years The primary endpoints related to school staff implementing the interventions are measures of content and process fidelity. Process fidelity for the group interventions CPP and CATS will be assessed via an adapted version of the rating system developed by Lochman and colleagues. 70 Ten items are rated on a scale of 0 to 4, with 0 being "Not At All" and 4 being "Very Often". Ratings are given on the extent to which school staff members delivered the intervention in an orderly fashion, using active learning strategies. etc. Exploratory factor analysis (EFA) yielded two factors on the 10-item scale.
- Secondary Outcome Measures
Name Time Method Perceived mediators and moderators of consultation support Up to 3 years Secondary endpoints are the mediators and moderators effects of consultation support on behavioral health staff fidelity and the qualitative examination of school staff's perceived feasibility, appropriateness and acceptability of the support they received.
Trial Locations
- Locations (1)
Children's Hospital of Philadelphia
🇺🇸Philadelphia, Pennsylvania, United States