The Role of Supplementary Material in Journal Articles Surveys of Authors, Reviewers and Readers Questionnaire Trial
Trial Snapshot
- Phase
- Not Applicable
- Status
- Completed
- Sponsor
- Enrollment
- 2,872
- Locations
- 2
- Primary Endpoint
- Completion
Study Overview
Brief Summary
Questionnaires are frequently used in online research, however recruiting, and completion rates of online participants from a variety of cultures and demographic backgrounds can be challenging. The challenge is greater in an online cohort because there is no way to observe the participant beyond what is contributed online. Poor recruiting and completion can result in underpowered research that may not be representative of the sample population. This can trigger an increase in costs as the recruitment period may have to be extended until sample size is reached. When recruiting and completion rates are inadequate studies may have to be terminated and the answer to the research question can remain unknown.
To mitigate these challenges, incentives may be offered in the form of gift certificate draws. There is uncertainty about whether this strategy is effective in online research and if the value of the incentive alters the outcome. A randomised trial can be used to test the intervention to establish an evidence base.
This study (SupMatQT) proposes to link with a large 20,000 person international cohort study (SupMat) that will test the utility and preferences of journal supplementary materials for reviewers, authors,and readers. The research described here will examine the evidence of effect for offering a prize draw incentive on rates of recruitment, and completion for consented participants. All participants will be entered in the draw. Information about the value of the incentive of a prize draw will differ according to what group a participant is randomized to. The entry in the prize draw will not be conditional on levels of participation or group allocation.
The other question researchers will address is what effect do survey reminders have on outcomes? All non-responders will be sent an initial reminder to complete the survey (Group A) and for those who have still not responded a second reminder will be sent 14 days later (Group B). Outcomes will be compared at three time points: for initial response, following reminder 1(Group A), and following reminder 2 (Group B).
Detailed Description
The Role of Supplementary Material in Journal Articles is a research collaboration between the BMJ, University of Oxford, and Queen's University Belfast where the research team aims to explore the usage patterns of supplementary materials for journal articles by authors, peer reviewers, and readers and to compare authors, peer reviewers and readers responses to these materials. The large cohort provides a unique opportunity to conduct methodology research with online participants using a nested cohort study defined as a study within a trial (SWAT). The nested study "The Role of Supplementary Material in Journal Articles Questionnaire Study " will explore the effects of recruitment and survey completion when a prize draw for participants is included in the invitation letter.
Large research populations can struggle to recruit participants and to obtain complete data. This can have a direct effect on the robustness of the findings and can undermine the often substantial investment, participants, researchers, and sponsors have made in the research. This research waste may undermine public trust and community enthusiasm for the research process. It may seem logical to offer a prize-winning draw as an incentive but only a trial can give objective information about how well this intervention works. It is cost effective to embed this research at the beginning of an existing large cohort study as funding may not be available to test the intervention as a stand alone question. The additional question of interest addressed will be asking whether one survey reminder or two is more effective in terms of recruitment and survey completion rates. The question is practical as ineffective reminders use researcher resources, increase the burden of participation on the participant and could build resentment if the respondent feels "spammed" whereas the ideal balance of reminders will result in increased recruitment and survey completion rates.
Participants in this cohort are drawn from a convenience sample of BMJ Publishing Group's journals that have a spread of Impact Factors, including the BMJ. Included journals have a website and publish supplementary material.
Devoting time and resources to understand what strategies will mobilize participants to remain motivated to join a study and complete the conditions is good planning and contributes to robust methods that other researchers can replicate. To the investigators' knowledge, no similar work has been conducted solely within the online population of readers, peer reviewers and authors of an academic journal group.
The aims of the study are to test the effect of:
Study Design
- Study Type
- Interventional
- Allocation
- Randomized
- Intervention Model
- Parallel
- Primary Purpose
- Health Services Research
- Masking
- Double (Participant, Outcomes Assessor)
Eligibility Criteria
- Ages
- 18 Years to — (Adult, Older Adult)
- Sex
- All
- Accepts Healthy Volunteers
- Yes
Inclusion Criteria
- •Part of SupMat Research
- •Corresponding authors of BMJ Group full-length original research submissions in 2013
- •BMJ Group Reviewers who completed a review of a manuscript for "original research", "research" or "paper" in
- •BMJ authors, reviewers, and reviewers with a viable email address
Exclusion Criteria
- •Not Part of SupMat Research
- •Potential participants who have opted out of BMJ communications
- •Participants in BMJ surveys within the last 6 months
Outcomes
Primary Outcomes
Completion
Time Frame: Duration of study up to 60 days
proportion of questions completed in the questionnaire
Secondary Outcomes
- Recruitment(Duration of study up to 60 days)