LSTM Home > LSTM Research > LSTM Online Archive

Ten tips for successful assessment of risk of bias in randomized trials using the RoB 2 tool: Early lessons from Cochrane

Moore, Theresa H. M., Higgins, Julian P. T. and Dwan, Kerry (2023) 'Ten tips for successful assessment of risk of bias in randomized trials using the RoB 2 tool: Early lessons from Cochrane'. Cochrane Evidence Synthesis and Methods, Vol 1, Issue 10, e12031.

[img]
Preview
Text
cesm.12031.pdf - Published Version
Available under License Creative Commons Attribution.

Download (1MB) | Preview

Abstract

Introduction:
RoB 2 is a tool used by systematic reviewers to assess risk of bias in randomized trials. Over a period of 19 months working as editors for Cochrane, we saw many instances where users of RoB 2 frequently applied the tool in ways the developers had not intended, despite availability of detailed guidance, webinars and FAQs.

Methods:
In this paper we highlight the ten main issues that we observed, with the aims of optimising the application of the RoB 2 tool, avoiding some of the frequent misapplications of the tool.

Results:
Issues noted included failure to state an effect of interest, applying the tool to an entire study rather than to a specific numerical result, omitting key signaling questions and relying on outdated views of causes of bias.

Conclusion:
Such omissions and misapplications can lead to overly harsh or lenient assessments of bias with potential to change the confidence we have in an evidence base of randomized trials. We recommend that teams planning to use RoB 2 include at least one member familiar with the RoB 2 detailed guidance and that they use the free resources, such as webinars and FAQs, from the developers of RoB 2 and Cochrane. Our ten tips should be useful to non‐Cochrane systematic reviewers as well as to peer reviewers and editors in Cochrane and other journals.

Item Type: Article
Subjects: WA Public Health > Statistics. Surveys > WA 900 Public health statistics
Faculty: Department: Clinical Sciences & International Health > Clinical Sciences Department
Digital Object Identifer (DOI): https://doi.org/10.1002/cesm.12031
SWORD Depositor: JISC Pubrouter
Depositing User: JISC Pubrouter
Date Deposited: 04 Dec 2023 10:41
Last Modified: 04 Dec 2023 10:41
URI: https://archive.lstmed.ac.uk/id/eprint/23615

Statistics

View details

Actions (login required)

Edit Item Edit Item