LSTM Home > LSTM Research > LSTM Online Archive

Indirect Comparisons: A Review of Reporting and Methodological Quality

Donegan, Sarah, Williamson, Paula, Gamble, Carrol and Tudur-Smith, Catrin (2010) 'Indirect Comparisons: A Review of Reporting and Methodological Quality'. PLoS ONE, Vol 5, Issue 11.

Plos_ONE_5_11_e11054.pdf - Published Version
Available under License Creative Commons Attribution.

Download (212kB)


Background: The indirect comparison of two interventions can be valuable in many situations. However, the quality of an indirect comparison will depend on several factors including the chosen methodology and validity of underlying
assumptions. Published indirect comparisons are increasingly more common in the medical literature, but as yet, there are no published recommendations of how they should be reported. Our aim is to systematically review the quality of published indirect comparisons to add to existing empirical data suggesting that improvements can be made when reporting and applying indirect comparisons.

Methodology/Findings: Reviews applying statistical methods to indirectly compare the clinical effectiveness of two
interventions using randomised controlled trials were eligible. We searched (1966–2008) Database of Abstracts and Reviews of Effects, The Cochrane library, and Medline. Full review publications were assessed for eligibility. Specific criteria to assess quality were developed and applied. Forty-three reviews were included. Adequate methodology was used to calculate the indirect comparison in 41 reviews. Nineteen reviews assessed the similarity assumption using sensitivity analysis, subgroup analysis, or meta-regression. Eleven reviews compared trial-level characteristics. Twenty-four reviews assessed statistical
homogeneity. Twelve reviews investigated causes of heterogeneity. Seventeen reviews included direct and indirect evidence for the same comparison; six reviews assessed consistency. One review combined both evidence types. Twentyfive reviews urged caution in interpretation of results, and 24 reviews indicated when results were from indirect evidence by stating this term with the result.
Conclusions: This review shows that the underlying assumptions are not routinely explored or reported when undertaking indirect comparisons. We recommend, therefore, that the quality of indirect comparisons should be improved, in particular, by assessing assumptions and reporting the assessment methods applied. We propose that the quality criteria applied in this article may provide a basis to help review authors carry out indirect comparisons and to aid appropriate interpretation.

Item Type: Article
Subjects: WA Public Health > WA 20.5 Research (General)
Faculty: Department: Groups (2002 - 2012) > International Health Group
Digital Object Identifer (DOI):
Depositing User: Faye Moody
Date Deposited: 05 Jan 2011 11:14
Last Modified: 06 Feb 2018 13:02


View details

Actions (login required)

Edit Item Edit Item