LSTM Home > LSTM Research > LSTM Online Archive

Independent evaluation of 12 artificial intelligence solutions for the detection of tuberculosis

Codlin, Andrew J., Dao, Thang Phuoc, Vo, Luan Nguyen Quang, Forse, Rachel J., Van Truong, Vinh, Dang, Ha Minh, Nguyen, Lan Huu, Nguyen, Hoa Binh, Nguyen, Nhung Viet, Sidney-Annerstedt, Kristi, Squire, Bertie ORCID:, Lönnroth, Knut and Caws, Maxine ORCID: (2021) 'Independent evaluation of 12 artificial intelligence solutions for the detection of tuberculosis'. Scientific Reports, Vol 11, Issue 1, p. 23895.

s41598-021-03265-0.pdf - Published Version
Available under License Creative Commons Attribution.

Download (1MB) | Preview


There have been few independent evaluations of computer-aided detection (CAD) software for tuberculosis (TB) screening, despite the rapidly expanding array of available CAD solutions. We developed a test library of chest X-ray (CXR) images which was blindly re-read by two TB clinicians with different levels of experience and then processed by 12 CAD software solutions. Using Xpert MTB/RIF results as the reference standard, we compared the performance characteristics of each CAD software against both an Expert and Intermediate Reader, using cut-off thresholds which were selected to match the sensitivity of each human reader. Six CAD systems performed on par with the Expert Reader (, DeepTek, Delft Imaging, JF Healthcare, OXIPIT, and Lunit) and one additional software (Infervision) performed on par with the Intermediate Reader only., Delft Imaging and Lunit were the only software to perform significantly better than the Intermediate Reader. The majority of these CAD software showed significantly lower performance among participants with a past history of TB. The radiography equipment used to capture the CXR image was also shown to affect performance for some CAD software. TB program implementers now have a wide selection of quality CAD software solutions to utilize in their CXR screening initiatives

Item Type: Article
Subjects: W General Medicine. Health Professions > W 82 Biomedical technology (General)
WF Respiratory System > Tuberculosis > WF 200 Tuberculosis (General)
WF Respiratory System > Tuberculosis > WF 220 Diagnosis. Prognosis
WF Respiratory System > Tuberculosis > WF 225 Mass chest X-ray
Faculty: Department: Clinical Sciences & International Health > Clinical Sciences Department
Digital Object Identifer (DOI):
Depositing User: Marie Hatton
Date Deposited: 11 Jan 2022 12:11
Last Modified: 11 Jan 2022 12:11


View details

Actions (login required)

Edit Item Edit Item