Best Practice in Systematic Reviews: The Importance of Protocols and Registration
- To add a note, highlight some text. Hide notes
- Make a general comment
Citation: The PLoS Medicine Editors (2011) Best Practice in Systematic Reviews: The Importance of Protocols and Registration. PLoS Med 8(2): e1001009. doi:10.1371/journal.pmed.1001009
Published: February 22, 2011
Copyright: © 2011 PLoS Medicine Editors. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The authors are each paid a salary by the Public Library of Science, and they wrote this editorial during their salaried time.
Competing interests: The authors' individual competing interests are athttp://www.plosmedicine.org/static/editorsInterests.action. PLoS is funded partly through manuscript publication charges, but the PLoS Medicine Editors are paid a fixed salary (their salary is not linked to the number of papers published in the journal).
* E-mail: medicine_editors@plos.org
The PLoS Medicine Editors are Virginia Barbour, Jocalyn Clark, Susan Jones, Melissa Norton, and Emma Veitch.
Provenance: Written by editorial staff; not externally peer reviewed.
It is now just over six years [1] since many medical journals began requiring that trials be registered before considering the trial report for publication. Such a policy was set up explicitly to reduce what was considered to be widespread bias in favor of publication of “positive” trials and to ensure that all clinical trials be made public prior to participant enrollment. Given the importance of clinical trials for estimating the efficacy and safety of interventions, and their role in approval of new drugs and devices, such a policy seemed uncontroversial. Although it is known that some trials still go unregistered, there are strong incentives (such as journal publication) and, in some countries legally enforceable mandates, for authors to register these studies before enrolling patients. The existence and widespread uptake of trial registration helps researchers, patients, and funders understand how many trials are being undertaken and which interventions are being evaluated. It also allows studies to be traced from inception through to completion and publication [2].
However, well-conducted systematic reviews—overviews of health care interventions that use a predefined, explicit methodology to find and synthesize all the relevant evidence—are generally considered higher-caliber evidence than are individual trials in decision-making for clinical practice and health policy. The superiority given to such reviews derives from key aspects inherent to the process of carrying out a systematic review. This study type, if done properly, allows the review to come closer to estimating the true effect of an intervention than any single study can, for two main reasons. First, such reviews collect and synthesize all relevant studies; second, reviews appraise each included study for risk of bias.
However, there is increasing evidence of the existence of publication bias for systematic reviews. A recent survey [3] indicates that nonpublication of completed studies may be as much of a problem for systematic reviews as it is for trials. Other analyses [4],[5] point to the existence of discrepancies between systematic review protocols and the published report, with one study [5] showing that the outcomes included in published systematic reviews may be biased toward “positive” findings. It is crucially important, therefore, that if the evidence from these studies is to be incorporated into clinical practice, the review is as rigorous and as fully reported as possible. For example, it should be obvious to readers whether there was a prespecified protocol for the review, that deviations are noted, and whether outcomes from the review are reported according to the original study plan. Increased clarity surrounding systematic review conduct and reporting would be possible if the protocols for systematic reviews, just like those for trials, were registered [6],[7].
Systematic reviews conducted under the auspices of the Cochrane Collaboration are registered early, at the protocol development stage. This registration helps minimize bias in the conduct and reporting of the review, reduce duplication of effort between groups, and keep systematic reviews updated. However, until now no overarching registry open to all researchers, worldwide, has existed for recording the existence and development of systematic reviews from inception through to completion.
This month, the Centre for Reviews and Dissemination (University of York, UK), supported by the UK National Institutes of Health Research and in collaboration with an international advisory group, announces PROSPERO, its international Prospective Register of Ongoing Systematic Reviews. Following months of public consultation, with many hundreds of respondents from 34 countries providing input on the proposed registration process and minimum dataset, PROSPERO is now open for business [8]. Registration is free, is available to anyone around the world, and generates a unique identifying number for each registered systematic review, which can (and should) be reported in any publications that arise from the study. Investigators should use the registry to record the existence of the protocol for a planned or ongoing systematic review of health care interventions even before screening studies for inclusion in the systematic review. A minimum dataset specifies the key items that are required for a systematic review to be meaningfully registered. Key data items include a statement of the research question, patients and population, study intervention(s) and outcomes; criteria for inclusion and exclusion of studies in the systematic review; outline of search strategy; and methods to assess risk of bias and for analysis of studies included in the systematic review.
With a clear system in place for registration of new and ongoing systematic reviews, PLoS Medicineannounces its support for this initiative. The journal wishes to promote best practice in the conduct and reporting of systematic reviews. Best practice includes registration during the protocol phase in PROSPERO or other appropriate registry, conduct of the review in accordance with a fully developed protocol, and reporting in line with the PRISMA guidelines [9]. PLoS Medicine and other PLoS journals will now start asking authors on submission whether registered their systematic review, and if so, to provide us with the registry number, which will be included in the final published article if the study is accepted for publication in the journal. We will also encourage authors to submit copies of their protocols, which will be available for reviewers and editors as part of the review process, and then published as supporting information alongside the full report of the systematic review.
We recognize that it is still early days for registration of systematic reviews. As a result, the PLoS Medicine editors are keen to hear from our readers and authors about this new initiative. We recognize that efforts such as this cannot alone eliminate bias in the conduct and reporting of research. We also appreciate that an additional burden is posed to prospective authors; as such we will reassess the PLoS policy on systematic review registration within a year. The research community is still in the process of learning what the publication outcomes are of cohorts of trials registered in the main registries, such as ClinicalTrials.gov and ISRCTN, since these sites were set up and widely supported by medical journals [2]. It will be some time before the uptake and outcomes of systematic review registration are known. We hope, however, that the future success of this initiative will contribute toward increased rigor and transparency of the systematic review literature.
Acknowledgments Top
The editors would like to thank David Moher and Lesley Stewart, both members of the international advisory board of PROSPERO, for their comments on an earlier draft of this editorial. David Moher is also a PLoS Medicine editorial board member.
Author Contributions Top
Wrote the first draft of the paper: EV. Contributed to the writing of the paper: VB JC SJ MN.
References Top
- (2004) Clinical trial registration: A statement from the International Committee of Medical Journal Editors. Ann Intern Med 141: 477–478. FIND THIS ARTICLE ONLINE
- (2009) Trial publication after registration in ClinicalTrials.Gov: A cross-sectional analysis. PLoS Med 6: e1000144. doi:10.1371/journal.pmed.1000144.
- (2009) An international survey indicated that unpublished systematic reviews exist. J Clin Epidemiol 62: 617–623. FIND THIS ARTICLE ONLINE
- (2010) Bias due to changes in specified outcomes during the systematic review process. PLoS One 5: e9810. doi:10.1371/journal.pone.0009810.
- (2002) Publishing protocols of systematic reviews: Comparing what was done to what was planned. JAMA 287: 2831–2834. FIND THIS ARTICLE ONLINE
- (2010) Registering systematic reviews. CMAJ 182: 13–14. FIND THIS ARTICLE ONLINE
- (2011) An international registry of systematic-review protocols. Lancet 377: 108–109. FIND THIS ARTICLE ONLINE
- PROSPERO Register of Ongoing Systematic Reviews. Available:http://www.crd.york.ac.uk/PROSPERO.
- (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration PLoS Med 6: e1000100. doi:10.1371/journal.pmed.1000100.
No hay comentarios:
Publicar un comentario