Evaluating the Checklist for Artificial Intelligence in Medical Imaging (CLAIM)-Based Quality of Reports Using Convolutional Neural Network for Odontogenic Cyst and Tumor Detection
Source abstract
Abstract
This review aimed to explore whether studies employing a convolutional neural network (CNN) for odontogenic cyst and tumor detection follow the methodological reporting recommendations, the checklist for artificial intelligence in medical imaging (CLAIM). We retrieved the CNN studies using panoramic and cone-beam-computed tomographic images from inception to April 2021 in PubMed, EMBASE, Scopus, and Web of Science. The included studies were assessed according to the CLAIM. Among the 55 studies yielded, 6 CNN studies for odontogenic cyst and tumor detection were included. Following the CLAIM items, abstract, methods, results, discussion across the included studies were insufficiently described. The problem areas included item 2 in the abstract; items 6–9, 11–18, 20, 21, 23, 24, 26–31 in the methods; items 33, 34, 36, 37 in the results; item 38 in the discussion; and items 40–41 in “other information.” The CNN reports for odontogenic cyst and tumor detection were evaluated as low quality. Inadequate reporting reduces the robustness, comparability, and generalizability of a CNN study for dental radiograph diagnostics. The CLAIM is accepted as a good guideline in the study design to improve the reporting quality on artificial intelligence studies in the dental field.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Dental Radiography and Imaging · Artificial Intelligence in Healthcare and Education · Radiomics and Machine Learning in Medical Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Pediatric Dentistry, Institute of Oral Bioscience, School of Dentistry, Jeonbuk National University, Jeonju 54896, Korea
Research Institute of Clinical Medicine, Jeonbuk National University, Jeonju 54907, Korea
Biomedical Research Institute, Jeonbuk National University Hospital, Jeonju 54907, Korea
Faculty of Odonto-Stomatology, Hue University of Medicine and Pharmacy, Hue University, Hue 52000, Vietnam
Funding
National Research Foundation of Korea
References (29)
Show source-provided references
1. Convolutional neural networks for dental image diagnostics: A scoping review10.1016/j.jdent.2019.103226 ↗
2. Application of artificial intelligence in dentistry10.1177/0022034520969115 ↗
3. Multiclass CBCT image segmentation for orthodontics with deep learning10.1177/00220345211005338 ↗
4. Deep-learning for predicting C-shaped canals in mandibular second molars on panoramic radiographs10.1259/dmfr.20200513 ↗
5. A pilot study of a deep learning approach to submerged primary tooth classification and detection
6. Automatic diagnosis for cysts and tumors of both jaws on panoramic radiographs using a deep convolution neural network10.1259/dmfr.20200185 ↗
7. Diagnosis of cystic lesions using panoramic and cone beam computed tomographic images based on deep learning neural network10.1111/odi.13223 ↗
8. Automatic detection and classification of radiolucent lesions in the mandible on panoramic radiographs using a deep learning object detection technique10.1016/j.oooo.2019.05.014 ↗
9. Guidelines for developing and reporting machine learning predictive models in biomedical research: A multidisciplinary view10.2196/jmir.5870 ↗
10. Peering into the black box of artificial intelligence: Evaluation metrics of machine learning methods10.2214/AJR.18.20224 ↗
11. Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction10.1148/radiol.2017171920 ↗
12. Assessing radiology research on artificial intelligence: A brief guide for authors, reviewers, and readers-from the radiology editorial board10.1148/radiol.2019192515 ↗
13. STARD 2015: An updated list of essential items for reporting diagnostic accuracy studies10.1148/radiol.2015151516 ↗
14. Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD initiative10.1148/radiol.2261021292 ↗
15. STARD 2015 guidelines for reporting diagnostic accuracy studies: Explanation and elaboration10.1136/bmjopen-2016-012799 ↗
16. The STARD initiative10.1016/S0140-6736(03)12122-8 ↗
17. Better reporting of studies on artificial intelligence: CONSORT-AI and beyond10.1177/0022034521998337 ↗
18. Artificial intelligence in dental research: Checklist for authors, reviewers, readers10.1016/j.jdent.2021.103610 ↗
19. Checklist for Artificial Intelligence in Medical Imaging (CLAIM): A guide for authors and reviewers10.1148/ryai.2020200029 ↗
20. Differential diagnosis of ameloblastoma and odontogenic keratocyst by machine learning of panoramic radiographs10.1007/s11548-021-02309-0 ↗
21. Yang, H., Jo, E., Kim, H.J., Cha, I.H., Jung, Y.S., Nam, W., Kim, J.Y., Kim, J.K., Kim, Y.H., and Oh, T.G. (2020). Deep learning for automated detection of cyst and tumors of the jaw in panoramic radiographs. J. Clin. Med., 9.10.3390/jcm9061839 ↗
22. Application of convolutional neural network in the diagnosis of jaw tumors10.4258/hir.2018.24.3.236 ↗
23. Brain metastasis detection using machine learning: A systematic review and meta-analysis10.1093/neuonc/noaa232 ↗
24. Si, L., Zhong, J., Huo, J., Xuan, K., Zhuang, Z., Hu, Y., Wang, Q., Zhang, H., and Yao, W. (2021). Deep learning in knee imaging: A systematic review utilizing a Checklist for Artificial Intelligence in Medical Imaging (CLAIM). Eur. Radiol.10.1007/s00330-021-08190-4 ↗
25. Systematic review of research design and reporting of imaging studies applying convolutional neural networks for radiological cancer diagnosis10.1007/s00330-021-07881-2 ↗
26. A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: A systematic review and meta-analysis10.1016/S2589-7500(19)30123-2 ↗
27. Artificial intelligence versus clinicians: Systematic review of design, reporting standards, and claims of deep learning studies10.1136/bmj.m689 ↗
28. Demystifying AI in healthcare10.1136/bmj.m3505 ↗
29. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning10.1109/TMI.2016.2528162 ↗