GRADE guidance 37: rating imprecision in a body of evidence on test accuracy.

Mustafa, Reem A, El Mikati, Ibrahim K, Murad, M Hassan, Hultcrantz, Monica, Steingart, Karen, Yang, Bada, Leeflang, Mariska M G, Akl, Elie A, Dahm, Philipp and Schünemann, Holger J (2023) 'GRADE guidance 37: rating imprecision in a body of evidence on test accuracy.'. Journal of Clinical Epidemiology, Vol 165, p. 111189.

Full text not available from this repository.

Abstract

To provide guidance on rating imprecision in a body of evidence assessing the accuracy of a single test. This guide will clarify when Grading of Recommendations Assessment, Development and Evaluation (GRADE) users should consider rating down the certainty of evidence by one or more levels for imprecision in test accuracy. A project group within the GRADE working group conducted iterative discussions and presentations at GRADE working group meetings to produce this guidance. Before rating the certainty of evidence, GRADE users should define the target of their certainty rating. GRADE recommends setting judgment thresholds defining what they consider a very accurate, accurate, inaccurate, and very inaccurate test. These thresholds should be set after considering consequences of testing and effects on people-important outcomes. GRADE's primary criterion for judging imprecision in test accuracy evidence is considering confidence intervals (i.e., CI approach) of absolute test accuracy results (true and false, positive, and negative results in a cohort of people). Based on the CI approach, when a CI appreciably crosses the predefined judgment threshold(s), one should consider rating down certainty of evidence by one or more levels, depending on the number of thresholds crossed. When the CI does not cross judgment threshold(s), GRADE suggests considering the sample size for an adequately powered test accuracy review (optimal or review information size [optimal information size (OIS)/review information size (RIS)]) in rating imprecision. If the combined sample size of the included studies in the review is smaller than the required OIS/RIS, one should consider rating down by one or more levels for imprecision. This paper extends previous GRADE guidance for rating imprecision in single test accuracy systematic reviews and guidelines, with a focus on the circumstances in which one should consider rating down one or more levels for imprecision. [Abstract copyright: Copyright © 2023. Published by Elsevier Inc.]

Item Type:	Article
Subjects:	W General Medicine. Health Professions > Professional practice > W88 Administrative work. Teaching. Research WA Public Health > Health Administration and Organization > WA 525 General works
Faculty: Department:	Clinical Sciences & International Health > Clinical Sciences Department
Digital Object Identifer (DOI):	https://doi.org/10.1016/j.jclinepi.2023.10.005
SWORD Depositor:	JISC Pubrouter
Depositing User:	JISC Pubrouter
Date Deposited:	14 May 2024 13:34
Last Modified:	14 May 2024 13:34
URI:	https://archive.lstmed.ac.uk/id/eprint/24457

Statistics

View details

Actions (login required)

Edit Item