Student Outcomes of Integrative Mental Health Services
- Conditions
- DepressionAnxietyTraumaBehavior Problems
- Interventions
- Behavioral: Modular Approach to Therapy for Children with Anxiety, Depression, Trauma, and Conduct ProblemsBehavioral: Treatment as usualOther: Monitoring and Feedback System
- Registration Number
- NCT02877875
- Lead Sponsor
- Harvard University
- Brief Summary
The study will compare the impact of Child STEPs (see Weisz et al., 2012) versus usual school-based therapy on students' mental health and school-related outcomes, and test whether changes in school outcomes are mediated by changes in student mental health.
- Detailed Description
This project will implement and evaluate the Child STEPs (see Weisz et al., 2012) treatment approach through a randomized controlled trial (RCT) at 27 K-8 public schools. The STEPs model has two components: (1) a modular protocol that combines 33 modules-i.e., descriptions of common elements within evidence-based therapies for anxiety, depression, post-traumatic stress, and conduct problems; and (2) a web-based system for monitoring student responses to treatment and providing weekly feedback to therapists, to guide their selection and sequencing of the STEPs modules. The project will include an evaluation of the effectiveness of STEPS compared to "treatment as usual" (known as Usual Care or UC) on students' mental health and school-related outcomes, and an analysis of whether changes in school outcomes are mediated by changes in student mental health.
Recruitment & Eligibility
- Status
- COMPLETED
- Sex
- All
- Target Recruitment
- 143
- Enrolled in grades 2-7
- Have a primary clinical problem in the areas of anxiety, depression, conduct, or posttraumatic stress
- Clinically elevated problem levels on the Internalizing, Externalizing, Anxious-Depressed, Withdrawn-Depressed, Aggressive Behavior, or Rule-Breaking Behavior scales of the Child Behavior Checklist or Youth Self-Report or on the UCLA Post-traumatic Stress Disorder Reaction Index
- Mental retardation
- Pervasive developmental disorder
- Eating disorders
- Children for whom attention problems or hyperactivity are the primary referral concern
- Active psychosis and/or a suicide attempt in the previous year
Study & Design
- Study Type
- INTERVENTIONAL
- Study Design
- PARALLEL
- Arm && Interventions
Group Intervention Description Child STEPS Monitoring and Feedback System Child STEPs includes (1) a treatment protocol, Modular Approach to Therapy for Children with Anxiety, Depression, Trauma or Conduct Problems (MATCH-ADTC;Chorpita \& Weisz, 2009), and (2) a youth monitoring and feedback system (MFS). Child STEPS Modular Approach to Therapy for Children with Anxiety, Depression, Trauma, and Conduct Problems Child STEPs includes (1) a treatment protocol, Modular Approach to Therapy for Children with Anxiety, Depression, Trauma or Conduct Problems (MATCH-ADTC;Chorpita \& Weisz, 2009), and (2) a youth monitoring and feedback system (MFS). Usual Care Treatment as usual Treatment in the UC condition will use the procedures therapists and their supervisors consider appropriate and believe to be effective, and researchers will not influence their work.
- Primary Outcome Measures
Name Time Method Change in top problems per youth- and caregiver-report. Change over time from Baseline (Day 1) through study completion (up to 66 weeks) The Top Problems Assessment-Youth and Caregiver Report (TPA- Youth and Caregiver) is a brief idiographic instrument designed to help identify and monitor youth problems that are especially important from the perspectives of the youth and caregiver. The TPA- Youth and Caregiver were shown to complement standardized measures and offer incremental utility, with evidence of test- retest reliability, convergent and discriminant validity, and sensitivity to change during treatment. The TPA-Youth and Caregiver is administered weekly.
Academic outcomes, assessed via school grades and standardized test performance Yearly, assessed up to 52 weeks Academic outcomes as obtained through class grades and standardized school testing.
Change in school engagement per self- and caregiver-report. Change over time from Baseline (Day 1) through study completion (up to 66 weeks) The National Survey of American Families (NSAF-Youth and Caregiver) School Engagement Scale is a youth- and caregiver-reported is a measure of behavioral, emotional, and cognitive engagement in school. Respondents rate youth on a four-point scale on items assessing whether the youth cares about doing well in school, only works on schoolwork when forced to, does just enough schoolwork to get by, and always does their homework
Change in school engagement per teacher-report. Change over time from Baseline (Day 1) through Post-treatment (up to 34 weeks) The National Survey of American Families (NSAF-Teacher) School Engagement Scale is a measure of behavioral, emotional, and cognitive engagement in school. Respondents rate youth on a four-point scale on items assessing whether the youth cares about doing well in school, only works on schoolwork when forced to, does just enough schoolwork to get by, and always does their homework. NSAF-Teacher is administered monthly.
Change in internalizing and externalizing problems per self- and caregiver-report. Change over time from Baseline (Day 1) through study completion (up to 66 weeks) The Behavior and Feelings Survey-Youth and Caregiver Report (BFS-Youth and Caregiver) is a no-cost, 12-item, youth- and caregiver-report measure of internalizing and externalizing problems. The BFS-Youth and Caregiver showed robust factor structure, internal consistency, test-retest reliability, and slopes of change indicating efficacy in monitoring treatment progress during psychotherapy in four samples of youths aged 7-15 years. The BFS-Youth and Caregiver is administered weekly.
Change in internalizing and externalizing problems per teacher-report. Change over time from Baseline (Day 1) through post-treatment (up to 34 weeks) The Behavior and Feelings Survey-Teacher Report (BFS-Teacher) is a no-cost, 12-item, teacher-report measure of internalizing and externalizing problems. The BFS-Teacher showed robust factor structure, internal consistency, test-retest reliability, and slopes of change indicating efficacy in monitoring treatment progress during psychotherapy in four samples of youths aged 7-15 years. The BFS-Teacher is administered monthly.
Change in top problems per teacher-report. Change over time from Baseline (Day 1) through Post-treatment (up to 34 weeks) The Top Problems Assessment-Teacher Report (TPA-Teacher) is a brief idiographic instrument designed to help identify and monitor youth problems that are especially important from the perspectives of the youth's teacher. The TPA-Teacher has not yet been examined psychometrically. The TPA-Youth and Caregiver is administered monthly.
- Secondary Outcome Measures
Name Time Method University of California at Los Angeles (UCLA) Post-traumatic Stress Disorder Reaction Index Change over time from Baseline (Day 1) through study completion (up to 66 weeks) This 38-item measure is widely-used to assess child post-traumatic stress symptoms. Part I is a brief lifetime trauma screen. If the participant identifies significant trauma, Part II assesses Diagnostic and Statistical Manual-IV (DSM-IV) PTSD symptoms related to the trauma. Part III assesses frequency of post-traumatic stress symptoms during the past month. The UCLA Post-traumatic Stress Disorder Reaction Index is administered separately to youth and their caregivers at baseline, post-treatment, and 6 month follow-up.
Youth Satisfaction Questionnaire Post-treatment, assessed up to 42 weeks after baseline The Youth Satisfaction Questionnaire consists of 8 questions (e.g., "Overall, how happy are you with the help you got?") assessing the youth's satisfaction with mental health services.
Therapeutic Alliance Scale (TASC) Post-treatment, assessed up to 42 weeks after baseline Youth and caregivers will be given the TASC, to assess the quality of the youth's working alliance with the therapist.This 7-item scale comes in both a youth-report form and a parent-report form (parents reporting on their youth's relationship with the therapist).
The Children's Emotion Management Scale (CEMS) Change over time from Baseline (Day 1) through study completion (up to 66 weeks) The CEMS assesses children's self-report of sadness, anger, and worry regulation. Children indicate the frequency with which they engage in a variety of emotion management strategies using a Likert scale of 1 (hardly ever), 2 (sometimes), or 3 (often). Three subscales have been identified for each emotion: (a) Inhibition (four items),(b) Dysregulated Expression (three items), and (c) Emotion Regulation Coping (five items for sadness scale and four items for anger scale). Examination of the reliability of the CEMS anger and sadness scales indicate coefficient alphas that range from .62 to .77 and test-retest reliability ranging from .61 to .80 for the individual subscales. Children complete the CEMS at baseline, post-treatment, and 6 month follow-up.
Perceived Control Scale for Children (PCSC) Change over time from Baseline (Day 1) through study completion (up to 66 weeks) The PCSC assesses perceived ability to exert primary control -that is, to influence or alter objective events or conditions through one's own effort. Youth rate agreement with statements about their ability to exert primary control, with half the items worded in a positive direction (e.g., "I can do well on tests if I study hard.") and half in a negative direction (e.g., "I cannot get other kids to like me no matter how hard I try."). Responses can range from "very true" to "very false." This scale has shown acceptable internal consistency (α=0.88) and six-month test-retest reliability (r=0.57) as well as a strong inverse relation to depressive symptoms (r=0.58 with Children's Depression Inventory scores).
Reduced Aggression and Victimization Scales (RAVS) Change over time from Baseline (Day 1) through study completion (up to 66 weeks) The RAVS measures the frequency of reporting aggressive behaviors or of being victimized during the previous week prior to the survey. The scales are composed of six items each. Each point represents one instance of aggression or victimization reported by the child. The RAVS is administered at baseline, post-treatment, and 6 month follow-up.
Youth Self-Report (YSR) Change over time from Baseline (Day 1) through study completion (up to 66 weeks) Self-report measure of child behavioral and emotional problems. Each item is rated 0 (Not True), 1 (Somewhat or Sometimes True), or 2 (Very True or Often True). Measure generates a total problems scale, broadband Internalizing and Externalizing syndrome scales, and eight narrowband syndrome scales (e.g., Aggressive Behavior). The YSR is supported by extensive psychometric evidence. Youth complete the YSR at baseline, post-treatment, and 6 month follow-up.
Services Assessment for Children and Adolescents (SACA) Baseline (Day 1) through study completion (up to 66 weeks) To assess whether treatment reduced the need for other services, a modified version of the Services Assessment for Children and Adolescents (SACA), a standardized parent-report interview assessing use of multiple mental health services (e.g., medication for a behavioral or emotional problem, inpatient psychiatric hospitalization) will be administered. At pre-treatment, the reporting time frame will be the previous 6 months, to establish a baseline for each student; at post-treatment, the time frame will be the period when treatment was received; at follow-up, the time frame will be the 6 months since treatment ended.
Medication Questionnaire adapted from the Services for Children and Adolescents-Parent Interview (SCA-PI) Baseline (Day 1) through study completion (up to 66 weeks) To assess whether medication influenced students' intervention response, we ask caregivers a series of questions to assess medications, dosage, and reasons for the medications--adapted from the SCA-PI (a standardized parent-report interview). The SCA-PI has particular strength in medication assessment, including start dates, end dates, and dosage. The medication questionnaire is administered at baseline, post-treatment, and at 6-month follow-up.
Brief Symptom Inventory (BSI) Baseline (Day 1) Caregivers complete this 53-item, self-report measure of adult symptomatology at baseline. This measure generates scores on nine dimensions (e.g., Depression, Anxiety, Hostility) and a General Severity Index (GSI).
Caregiver Satisfaction Questionnaire Post-treatment, assessed up to 42 weeks after baseline Caregivers complete the Caregiver Satisfaction Questionnaire at post-treatment, assessed up to 40 weeks after baseline. The Caregiver Satisfaction Questionnaire is 8 questions (e.g., "How would you rate the quality of the counseling services that were provided?").
Teacher Report Form (TRF) Change over time from Baseline (Day 1) to Post-treatment (up to 34 weeks) Teacher-report measure of child behavioral and emotional problems. Each item is rated 0 (Not True), 1 (Somewhat or Sometimes True), or 2 (Very True or Often True). Measure generates a total problems scale, broadband Internalizing and Externalizing syndrome scales, and eight narrowband syndrome scales (e.g., Aggressive Behavior). The TRF is supported by extensive psychometric evidence.
Therapist Satisfaction Inventory (TSI) Post-treatment, assessed up to 42 weeks after baseline Therapists complete the TSI at the completion of treatment. The TSI is a 16-item measure that assesses whether therapists liked the treatment approach they used, whether the approach made them feel effective, whether they believe it allowed them to individualize treatment to fit the needs of the client, and whether it seems appropriate for the kinds of children they most often see.
Emotion Regulation Checklist (ERC) Change over time from Baseline (Day 1) through study completion (up to 66 weeks) The ERC is a 24-item questionnaire using a 4-point Likert scale that assesses the caregiver's perceptions of their children's ability to manage emotion. This measure yields two empirically derived scales: (a) Emotion Regulation that assesses situationally appropriate affective displays and emotional self-awareness, and (b) Lability/Negativity, which measures mood lability and culturally inappropriate affective displays. Internal consistency has been established for this measure as well as support for its construct validity. Caregivers complete the ERC at baseline, post-treatment, and 6-month follow-up.
The Children's Response Style Questionnaire (CRSQ) Change over time from Baseline (Day 1) through study completion (up to 66 weeks) The CRSQ is modeled after Nolen-Hoeksema's Response Styles Questionnaire and consists of 25 items, each of which describes a particular response to symptoms of depression. The items are grouped into three scales: (1) Ruminative Response subscale (CRSQ-Rumination); (2) Distracting Response subscale (CRSQ-Distraction); and (3) Problem-Solving subscale (CRSQ-Problem solving). For each item, youth are asked to indicate how often they respond in this way when they are feeling sad (almost never = 0,sometimes = 1, often = 2, or almost always = 3). Scores range from 0 to 39 on the Ruminative Response subscale, from 0 to 21 on the Distracting Response subscale, and from 0 to 15 on the Problem Solving subscale. Higher scores on each subscale indicate a greater tendency to engage in that particular response style.Children complete the CRSQ at baseline, post-treatment, and at 6 month follow-up.
Child Behavior Checklist (CBCL) Change over time from Baseline (Day 1) through study completion (up to 66 weeks) Caregiver-report measure of child behavioral and emotional problems. Each item is rated 0 (Not True), 1 (Somewhat or Sometimes True), or 2 (Very True or Often True). Measure generates a total problems scale, broadband Internalizing and Externalizing syndrome scales, and eight narrowband syndrome scales (e.g., Aggressive Behavior). The CBCL is supported by extensive psychometric evidence. Caregivers complete the CBCL at baseline, post-treatment, and 6 month follow-up.
Secondary Control Scale for Children (SCSC) Change over time from Baseline (Day 1) through study completion (up to 66 weeks) This 20-item scale was designed to assess perceived ability to exert secondary control-that is, to influence the personal psychological impact of objective conditions on oneself, by adjusting oneself to fit those conditions. The item content reflects response patterns associated with secondary control in the two-process model, for example, finding a silver lining, adjusting cognition, avoiding rumination, and generic secondary control. To discourage response sets, half the items are worded in a positive direction and half in a negative direction. Respondents rate their agreement with each item (on a 4-point scale, from "very false" to "very true").
Children's Alexithymia Scale (CAS) Change over time from Baseline (Day 1) through study completion (up to 66 weeks) The Children's Alexithymia Scale is based on the original Toronto Alexithymia Scale 20 that assesses alexithymia in adults.The Alexithymia Questionnaire for Children consists of 20 items that represent the three factors: Difficulty identifying feelings, Difficulty describing feelings and Externally oriented thinking. The item response format is: strongly disagree to strongly agree.
The School Engagement Measure-MacArthur Network Change over time from Baseline (Day 1) through study completion (up to 66 weeks) The School Engagement Measure-MacArthur Network is a youth-self report measure of three components of youth engagement that have been supported in factor analysis; these are: Behavioral, Emotional and Cognitive. The Cognitive subscale has not fared so well psychometrically, so only the two psychometrically stronger subscales: Behavioral and Emotional Engagement, will be administered to youth. Youth complete this measure at baseline, post-treatment, and 6 month follow-up.
Implicit Theories of Thoughts, Emotions, and Behaviors Scale (ITEB-Q) Change over time from Baseline (Day 1) through study completion (up to 66 weeks) This study includes a new scale adapted from Dweck's work on implicit theories for intelligence to measure implicit theories regarding thoughts, emotions, and behaviors. The ITEB-Q contains twelve items; four items each address implicit theories regarding thoughts, feelings, and behavior. Items on each subscale present extreme incremental theory beliefs (e.g., "When I try, I can control how I feel," "When I feel bad, I can make myself feel better"). Responses are measured using a four-point scale ranging from 1 ("Very False") to 4 ("Very True"). The higher participants' summed scores on the full ITEB-Q, the less they believe thoughts, emotions, and behavior are fixed entities.
Evidence-Based Practice Attitudes Scale (EBPAS) Change over time from Baseline (Day 1) to Post-treatment (up to 42 weeks) The EBPAS consists of 15 items measured on a 5-point scale ranging from 0 (Not at all) to 4 (To a very great extent). The EBPAS is comprised of four subscales (Appeal, Requirements, Openness, and Divergence) and a total scale score, which represents respondents' global attitude toward adoption of EBPs. Cronbach's alpha reliability for the EBPAS is good (alpha = 0.77), with subscale alphas ranging from 0.59 to 0.90.
Academic Competence Evaluation Scales Change over time from Baseline (Day 1) to Post-treatment (up to 34 weeks) School functioning in the classroom will be assessed via the Academic Competence Evaluation Scales (ACES) is a 60-item, teacher-reported scale which assesses youth Academic Skills (including Reading/Language Arts, Mathematics, and Critical Thinking) and Academic Enablers (including Interpersonal Skills, Engagement, Motivation, and Study Skills). The ACES has demonstrated internal consistency and test-retest reliability.
Trial Locations
- Locations (1)
Harvard University
🇺🇸Cambridge, Massachusetts, United States