Artificial Intelligence-Assisted Pulmonary Nodule Diagnosis by Thoracic Surgeons: A Comparative Study on Clinical Effectiveness.
Clinician experience variability affects lung cancer detection using computed tomography. AI-based computer-aided diagnosis (CAD) systems can improve diagnostic accuracy, but their influence on thoracic surgeons with varying experience is unclear. This study aimed to evaluate the impact of CAD system on thoracic surgeons' assessment of pulmonary nodule malignancy.
A multireader, crossover study included 20 thoracic surgeons (8 junior, 12 senior). Each reader interpreted 100 anonymized pulmonary nodules twice-once with CAD and once without-following a washout period. Nodules were assessed using a 10-point likelihood of malignancy (LOM) scale and a binary (benign/malignant) assessment.
The CAD system demonstrated high malignancy prediction (AUROC = 0.929). CAD assistance significantly improved diagnostic accuracy across all readers (AUROC: 0.770-0.804, p = 0.0014 [BINARY]; 0.833-0.879, p < 0.001 [LOM]). Junior readers showed greater improvement (BINARY: 0.780-0.848, p < 0.001; LOM: 0.838-0.904, p < 0.001) compared with senior readers (BINARY: 0.763-0.775, p = 0.344; LOM: 0.831-0.862, p = 0.026). Specificity significantly increased with CAD (p = 0.008 overall, p < 0.001 junior readers), while sensitivity remained unchanged. Reading time slightly increased with CAD for benign cases (p < 0.05), but remained stable for malignant cases.
The CAD system improved thoracic surgeons' diagnostic performance, especially junior readers, by enhancing specificity and overall accuracy. AI-based CAD systems are beneficial for reducing diagnostic variability and supporting lung nodule malignancy assessment by inexperienced thoracic surgeons.
A multireader, crossover study included 20 thoracic surgeons (8 junior, 12 senior). Each reader interpreted 100 anonymized pulmonary nodules twice-once with CAD and once without-following a washout period. Nodules were assessed using a 10-point likelihood of malignancy (LOM) scale and a binary (benign/malignant) assessment.
The CAD system demonstrated high malignancy prediction (AUROC = 0.929). CAD assistance significantly improved diagnostic accuracy across all readers (AUROC: 0.770-0.804, p = 0.0014 [BINARY]; 0.833-0.879, p < 0.001 [LOM]). Junior readers showed greater improvement (BINARY: 0.780-0.848, p < 0.001; LOM: 0.838-0.904, p < 0.001) compared with senior readers (BINARY: 0.763-0.775, p = 0.344; LOM: 0.831-0.862, p = 0.026). Specificity significantly increased with CAD (p = 0.008 overall, p < 0.001 junior readers), while sensitivity remained unchanged. Reading time slightly increased with CAD for benign cases (p < 0.05), but remained stable for malignant cases.
The CAD system improved thoracic surgeons' diagnostic performance, especially junior readers, by enhancing specificity and overall accuracy. AI-based CAD systems are beneficial for reducing diagnostic variability and supporting lung nodule malignancy assessment by inexperienced thoracic surgeons.
Authors
Jeon Jeon, Jeong Jeong, Park Park, Kang Kang, Hong Hong, Chung Chung, Park Park, Park Park
View on Pubmed