journal article·2022-12-13Open access

Applying Convolutional Neural Network in Automatic Assessment of Bone Age Using Multi-Stage and Cross-Category Strategy

Ching-Tung Peng, Yung-Kuan Chan, Yeong-Seng Yuh, Shyr-Shen Yu

Applied Sciences· Volume 12· Issue 24

Abstract

Bone age is a common indicator of children’s growth. However, traditional bone age assessment methods usually take a long time and are jeopardized by human error. To address the aforementioned problem, we propose an automatic bone age assessment system based on the convolutional neural network (CNN) framework. Generally, bone age assessment is utilized amongst 0–18-year-old children. In order to reduce its variation in terms of regression model building, our system consists of two steps. First, we build a maturity stage classifier to identify the maturity stage, and then build regression models for each maturity stage. In this way, assessing bone age through the use of several independent regression models will reduce the variation and make the assessment of bone age more accurate. Some bone sections are particularly useful for distinguishing certain maturity stages, but may not be effective for other stages, and thus we first perform a rough classification to generally distinguish the maturity stage, and then undertake fine classification. Because the skeleton is constantly growing during bone development, it is not easy to obtain a clear decision boundary between the various stages of maturation. Therefore, we propose a cross-stage class strategy for this problem. In addition, because fewer children undergo X-rays in the early and late stages, this causes an imbalance in the data. Under the cross-stage class strategy, this problem can also be alleviated. In our proposed framework, we utilize an MSCS-CNN (Multi-Step and Cross-Stage CNN). We experiment on our dataset, and the accuracy of the MSCS-CNN in identifying both female and male maturity stages is above 0.96. After determining maturity stage during bone age assessment, we obtain a 0.532 and 0.56 MAE (mean absolute error) for females and males, respectively.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Forensic Anthropology and Bioarchaeology Studies · Dental Radiography and Imaging · Human Pose and Action Recognition

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science and Engineering, National Chung Hsing University, Taichung City 402, Taiwan

Department of Management Information Systems, National Chung Hsing University, Taichung City 402, Taiwan

Department of Pediatrics, Cheng-Hsin General Hospital, Taipei City 112, Taiwan

Funding

Cheng Hsin General Hospital

References (30)

Show source-provided references
1. Radiographic atlas of skeletal development of the hand and wrist
2. Tanner, J.M., Healy, M.J.R., Cameron, N., and Goldstein, H. (2001). Assessment of Skeletal Maturity and Prediction of Adult Height (tw3 Method), W.B. Saunders.
3. Hierarchical fracture classification of proximal femur X-ray images using a multistage deep learning approach10.1016/j.ejrad.2020.109373 ↗
4. Arm fracture detection in X-rays based on improved deep convolutional neural network10.1016/j.compeleceng.2019.106530 ↗
5. Classifying shoulder implants in X-ray images using deep learning10.1016/j.csbj.2020.04.005 ↗
6. Rahman, T., Chowdhury, M.E., Khandakar, A., Islam, K.R., Islam, K.F., Mahbub, Z.B., Kadir, M.A., and Kashem, S. (2020). Transfer learning with deep convolutional neural network (CNN) for pneumonia detection using chest X-ray. Appl. Sci., 10.10.3390/app10093233 ↗
7. Kashin-beck disease diagnosis based on deep learning from hand X-ray images10.1016/j.cmpb.2020.105919 ↗
8. Fully automated deep learning system for bone age assessment10.1007/s10278-017-9955-8 ↗
9. Deep learning for automated skeletal bone age assessment in X-ray images10.1016/j.media.2016.10.010 ↗
10. Versatile framework for medical image processing and analysis with application to automatic bone age assessment
11. A multi-scale data fusion framework for bone age assessment with convolutional neural networks10.1016/j.compbiomed.2019.03.015 ↗
12. Regression convolutional neural network for automated pediatric bone age assessment from hand radiograph10.1109/JBHI.2018.2876916 ↗
13. Performance of a deep-learning neural network model in assessing skeletal maturity on pediatric hand radiographs10.1148/radiol.2017170236 ↗
14. Automatic feature extraction in X-ray image based on deep learning approach for determination of bone age10.1016/j.future.2019.10.032 ↗
15. Tw3-based fully automated bone age assessment system using deep neural networks10.1109/ACCESS.2019.2903131 ↗
16. A deep automated skeletal bone age assessment model via region-based convolutional neural network10.1016/j.future.2019.01.057 ↗
17. Incorporated region detection and classification using deep convolutional networks for bone age assessment10.1016/j.artmed.2019.04.005 ↗
18. Mimicking the radiologists’ workflow: Estimating pediatric hand bone age with stacked deep neural networks10.1016/j.media.2020.101743 ↗
19. An improved alexnet model for automated skeletal maturity assessment using hand X-ray images10.1016/j.future.2021.03.018 ↗
20. An automatic system for skeletal bone age measurement by robust processing of carpal and epiphysial/metaphysial bones10.1109/TIM.2010.2058210 ↗
21. Bone age assessment based on deep convolutional features and fast extreme learning machine algorithm10.3389/fenrg.2021.813650 ↗
22. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
23. Imagenet classification with deep convolutional neural networks
24. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
25. Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A.A. (2017, January 4–9). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.11231 ↗
26. Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
27. Gilsanz, V., and Ratib, O. (2005). Hand Bone Age: A Digital Atlas of Skeletal Maturity, Springer Science & Business Media.
28. Are loss functions all the same?10.1162/089976604773135104 ↗
29. Rajaraman, S., Zamzmi, G., and Antani, S. (2021). Multi-loss ensemble deep learning for chest X-ray classification. arXiv.
30. Díaz-Vico, D., Fernández, A., and Dorronsoro, J.R. (2021, January 22–24). Companion losses for deep neural networks. Proceedings of the International Conference on Hybrid Artificial Intelligence Systems, Bilbao, Spain.10.1007/978-3-030-86271-8_45 ↗