Testing Strategies to Improve Substance Misuse Prevention Research Use in State Policy Contexts

Not Applicable

Recruiting

• Conditions: Legislation; Substance Abuse; Substance Use Disorders; Prevention; Use of Research Evidence

• Registration Number: NCT06856148
• Lead Sponsor: Penn State University

Brief Summary

If science is to inform effective substance misuse prevention policy and ultimately improve public health, the field needs an effective strategy for directly supporting policymakers' use of research evidence, yet our field lacks an evidence-based model designed for this purpose. Accordingly, a state-level randomized controlled trial (N = 30 states) of a formal, theory-based approach for appropriately supporting policymakers' use of scientific evidence--known as the Research-to-Policy Collaboration (RPC) Model is proposed. This work has the potential to reduce population-level substance misuse by improving the use of scientific information in policymaking, thus increasing the availability of evidence-based prevention programs and policies.

Detailed Description

If science is to inform policy and ultimately improve public health, the field needs an effective strategy for directly supporting policymakers' use of research evidence. However, the field lacks an evidence-based model designed for supporting state policymakers' use of prevention research in crafting legislation. Instead, the field continues to largely rely on ad hoc strategies for translating prevention research (e.g., opportunistic outreach and responding to policymakers' requests if or when they are made). Accordingly, an experimental study of a formal, theory-based approach for supporting policymakers' use of scientific evidence that does not involve lobbying-the Research-to-Policy Collaboration (RPC) Model is proposed. The RPC fosters productive engagement between the policy and research communities by implementing systematic capacity building and outreach strategies. Previous experimental work on the RPC demonstrated the ability of this model to increase engagement between researchers and policymakers, increase policymakers' value for research evidence, and improve their use of scientific evidence in their policymaking.1 The study proposes a state-level randomized controlled trial of the RPC (N = 30 state legislatures) that will evaluate the model's ability to improve engagement between state policymakers' and the prevention science community, build policymakers' awareness and value of substance misuse prevention research, and subsequently their use of research evidence throughout the policymaking process. To accomplish this, the study will test three specific research aims. Aim 1 will assess historical and current use of research evidence in state legislation pertaining to substance misuse prevention. This will involve qualitative coding of bills introduced by state legislatures over the last five years. Aim 2 will compare the frequency and quality of engagement with prevention researchers between the intervention and control conditions. Additionally, the study will assess how the RPC model influences policymakers' value and awareness of substance misuse prevention over time using a validated survey across three time points. Aim 3 will evaluate the effectiveness of the RPC on legislators' actual use of research in legislation by observing and quantifying changes in legislator behavior related to research use. Improving the use of scientific information in policymaking can reduce population-level substance misuse by increasing the availability of evidence-based prevention programs and policies.

Study Timeline

• Study Start: 2023-04-01
• Study First Submitted: 2025-02-19
• Study First Submitted QC: 2025-02-25
• Status Verified: 2025-03
• Last Update Submitted: 2025-03-03
• Study First Posted: 2025-03-04
• Last Update Posted: 2025-03-06
• Primary Completion: 2027-03-31
• Study Completion: 2027-03-31

Recruitment & Eligibility

• Status: RECRUITING
• Sex: All
• Target Recruitment: 300

Inclusion Criteria

• State-level public officials

Exclusion Criteria

• Anyone who is not a state-level public official

Study & Design

• Study Type: INTERVENTIONAL
• Study Design: PARALLEL

Primary Outcome Measures

Name	Time	Method
RPC impact on introduction of evidence-informed bills	Baseline, post intervention, and 6-months post intervention	Assessment of use of research evidence in bills introduced during the intervention period. It is anticipated that legislators will introduce over 5,000 bills relating to substance use are. These bills will be coded for presence of evidence markers using a validated, deductive codebook to identify how legislators use research evidence in legislative language. A subset of these bills (N = 150) will be reviewed by trained coders to identify the form (i.e. direct or indirect) and the goal of evidence use (i.e., sharing the cause of the problem, status of the problem, solving the problem, generating new knowledge, or accountability). Observed use of research evidence in bills will be quantified and analyzed in a series of multi-level models to test change across three time points.

Secondary Outcome Measures

Name	Time	Method
RPC impact on legislators' perceived use of prevention research	Baseline, post intervention, and 6 months post-intervention	Legislators' perceived use of research evidence will be assessed with the Reported Use of Research Evidence Scale (minimum value = 1, maximum value =5, higher scores indicate increased use of research evidence), which assesses use of research across various stages of the policy process (e.g., agenda setting, policy evaluation) and the three types of research use (i.e., instrumental, conceptual, and symbolic). Research will be defined for participants as information gleaned from scientific studies, academic investigations, or program evaluations assessing the effectiveness of an intervention. Surveys from state legislators will be analyzed longitudinally by modeling change across the two time points-including multi-level repeated measures and growth curve models (MLM).
RPC impact on legislators' engagement with prevention researchers	Baseline, post collaboration, and 6 months post-intervention	The investigators will use validated quantitative survey instrument to investigate how the RPC model influences the frequency of policymakers' different types of interactions with researchers (5-pt. Likert scale; ɑ = .89). A series of multi-level models will be employed to account for the nested structure of the study design. In addition to main effects models at each time point, this includes a three-level design that nests legislators within their state legislature across 3 time points (baseline, post intervention, and 6 months following the intervention. Survey data will be modeled in terms of absolute difference and change from baseline to post-test to assess trial main effects. Survey data from state legislators will also be analyzed longitudinally across the three time points-including multi-level repeated measures and growth curve models (MLM) using MPlus.
RPC impact on state legislators' value of substance misuse prevention science	Baseline, post intervention, and 6 months post intervention	The investigators will use a validated quantitative survey instrument to assess how the RPC model influences legislators' perceived value of research use in their work and in policymaking more generally. It will be measured with an adapted version of the Seeking, Engaging with, and Evaluating Research (SEER) protocol. Policymakers will be asked to rate how strongly they agree with four statements assessing whether they feel they know general information pertaining to prevention programming. A series of multi-level models will be employed to account for the nested structure of the study design. In addition to main effects models at each time point, this includes a three-level design that nests legislators within their state legislature across 3 time points (baseline, post intervention, and 6 months following intervention). Survey data will be modeled in terms of absolute difference and change from baseline to post-test to assess trial main effects.
RPC effectiveness on legislators' awareness of substance misuse prevention science	Baseline, post intervention, and 6 months post-intervention	The investigators will use a validated quantitative survey instrument to investigate how the RPC model influences legislators' awareness of substance misuse prevention science. Policymakers will be asked to rate how strongly they agree with four statements assessing whether they feel they know general information pertaining to prevention programming. A series of multi-level models will be used to account for the nested structure of the study design. In addition to main effects models at each time point, this includes a three-level design that nests legislators within their state legislature across 3 time points (baseline, post intervention, and 6 months following intervention). Survey data will be modeled in terms of absolute difference and change from baseline to post-test to assess trial main effects.

Trial Locations

Locations (1)

Penn State University; 🇺🇸 University Park, Pennsylvania, United States