Back to List

Independent evaluation of 12 artifcial intelligence solutions for the detection of tuberculosis

Andrew J. Codlin et al. — Scientific Reports (2021)

Abstract


There have been few independent evaluations of computer-aided detection (CAD) software for tuberculosis (TB) screening, despite the rapidly expanding array of available CAD solutions. We developed a test library of chest X-ray (CXR) images which was blindly re-read by two TB clinicians with different levels of experience and then processed by 12 CAD software solutions. Using Xpert MTB/RIF results as the reference standard, we compared the performance characteristics of each CAD software against both an Expert and Intermediate Reader, using cut-off thresholds which were selected to match the sensitivity of each human reader. Six CAD systems performed on par with the Expert Reader (Qure.ai, DeepTek, Delft Imaging, JF Healthcare, OXIPIT, and Lunit) and one additional software (Infervision) performed on par with the Intermediate Reader only. Qure.ai, Delft Imaging and Lunit were the only software to perform significantly better than the Intermediate Reader. The majority of these CAD software showed significantly lower performance among participants with a past history of TB. The radiography equipment used to capture the CXR image was also shown to affect performance for some CAD software. TB program implementers now have a 

전체 내용 보기
AUTHORS

1.Andrew J. Codlin, 2.Thang Phuoc Dao, 1,2Luan Nguyen Quang Vo, 1,3.Rachel J. Forse, 4.Vinh Van Truong, 

4. Ha Minh Dang, 4.Lan Huu Nguyen, 5..Hoa Binh Nguyen, 

5.. Nhung Viet Nguyen, 3. Kristi Sidney-Annerstedt, 

6..Bertie Squire, 3. Knut Lönnroth & 6.7Maxine Caws 

1. Friends for International TB Relief (FIT), Ho Chi Minh City, Viet Nam

2. IRD VN, Ho Chi Minh City, Viet Nam

3.Department of Global Public Health, WHO Collaboration Centre on Tuberculosis and Social Medicine, Karolinska Institutet, Solna, Sweden

4..Pham Ngoc hach Hospital, Ho Chi Minh City, Viet Nam

5. National Lung Hospital, Ha Noi, Viet Nam

6. Department of Clinical Sciences, Liverpool School of Tropical Medicine (LSTM), Liverpool, UK

7..Birat Nepal Medical Trust, Kathmandu, Nepal

PUBLISHED
Scientific Reports (2021)

Read more