In Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association
PURPOSE : To (1) determine the diagnostic efficacy of artificial intelligence (AI) methods for detecting anterior cruciate ligament (ACL) and meniscus tears and to (2) compare the efficacy to human clinical experts.
METHODS : PubMed, OVID/Medline, and Cochrane libraries were queried in November 2019 for research articles pertaining to AI utilization for detection of ACL and meniscus tears. Information regarding AI model, prediction accuracy/area under the curve (AUC), sample sizes of testing/training sets, and imaging modalities were recorded.
RESULTS : A total of 11 AI studies were identified: 5 investigated ACL tears, 5 investigated meniscal tears, and 1 investigated both. The AUC of AI models for detecting ACL tears ranged from 0.895-0.980, and the prediction accuracy ranged from 86.7%-100%. Of these studies, three compared AI models to clinical experts. Two found no significant differences in diagnostic capability, while one found that radiologists had a significantly higher sensitivity for detecting ACL tears (p=0.002) and statistically similar specificity and accuracy. Of the 5 studies investigating the meniscus, the AUC for AI models ranged from 0.847-0.910 and prediction accuracy ranged from 75.0%-90.0%. Of these studies, 2 compared AI models to clinical experts. One found no significant differences in diagnostic accuracy, while one found that the AI model had a significantly lower specificity (p=0.003) and accuracy (p=0.015) than radiologists. Two studies reported that the addition of AI models significantly increased the diagnostic performance of clinicians compared to their efforts without these models.
CONCLUSION : AI prediction capabilities were excellent and may enhance the diagnosis of ACL and meniscal pathology; however, AI did not outperform clinical experts.
CLINICAL RELEVANCE : AI models promise to improve diagnosing certain pathologies as well as or better than human experts, are excellent for detecting ACL and meniscus tears, and may enhance the diagnostic capabilities of human experts; however, when compared to these experts, may not offer any significant advantage.
Kunze Kyle N, Rossi David M, White Gregory M, Karhade Aditya V, Deng Jie, Williams Brady T, Chahla Jorge