IFD: An Intelligent Fast Detection for Real-Time Image Information in Industrial IoT
Source abstract
Abstract
The processing of images by a convolutional neural network will lead to the loss of image information. Downsampling operation within the network is the main reason for the loss. To cut back the loss and reach an acceptable detection speed, this paper proposes an Intelligent Fast Detection for Real-time Image Information in Industrial IoT (IFD). IFD adopts the improved YOLO-Tiny framework and integrates the VaryBlock module. Firstly, we elect a tiny version of YOLO as the backbone and integrate the VaryBlock module into the network structure. Secondly, WGAN is applied to expand the training dataset of small objects. Finally, we use the unsupervised learning algorithm k-means++ to obtain the best-preset boundary box to improve the accuracy of the classification results. IFD optimizes the loss and detection accuracy of image information while meeting the detection speed. The MS-COCO dataset and RGB images in the TUM dataset are used for training and evaluating our model. The upgraded network’s average accuracy is around 8% higher than the YOLO-Tiny series network, according to the experimental data. The increased network’s detection speed in our hardware settings is at least 65 frames per second.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Industrial Vision Systems and Defect Detection · Video Surveillance and Tracking Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electronic Information Engineering, Shanghai DianJi University, 300 Shuihua Road, Pudong, Shanghai 201306, China
Department of Computer Science, Georgia State University, Atlanta, GA 30302, USA
Funding
National Natural Science Foundation of China · Shanghai Educational Science Research Project · Jiangxi Province’s Outstanding Youth Planning Project
References (59)
Show source-provided references
1. A review and state of art of Internet of Things (IoT)10.1007/s11831-021-09622-6 ↗
2. Process automation in an IoT-fog-cloud ecosystem: A survey and taxonomy10.3390/iot2010006 ↗
3. A Survey on Technologies, Standards and Open Challenges in Satellite IoT10.1109/COMST.2021.3078433 ↗
4. Chapter six-industry 4.0: Industrial internet of things (IIOT)10.1016/bs.adcom.2019.10.010 ↗
5. Industrial internet of things: Challenges, opportunities, and directions10.1109/TII.2018.2852491 ↗
6. Multi-source fusion for weak target images in the Industrial Internet of Things10.1016/j.comcom.2021.04.002 ↗
7. A target recognition algorithm of multi-source remote sensing image based on visual Internet of Things10.1007/s11036-021-01907-1 ↗
8. Intelligent remote monitoring and manufacturing system of production line based on industrial Internet of Things10.1016/j.comcom.2019.12.011 ↗
9. Sadeeq, M.A., Zeebaree, S.R., Qashi, R., Ahmed, S.H., and Jacksi, K. (2018, January 9–11). Internet of Things security: A survey. Proceedings of the 2018 International Conference on Advanced Science and Engineering (ICOASE), Duhok, Irak.
10. Sensor-fault detection, isolation and accommodation for digital twins via modular data-driven architecture10.1109/JSEN.2020.3029459 ↗
11. Design of deep learning algorithm for IoT application by image based recognition10.36548/jismac.2021.3.008 ↗
12. Latif, S., Driss, M., Boulila, W., Huma, Z.E., Jamal, S.S., Idrees, Z., and Ahmad, J. (2021). Deep learning for the industrial internet of things (iiot): A comprehensive survey of techniques, implementation frameworks, potential applications, and future directions. Sensors, 21.10.3390/s21227518 ↗
13. A survey of deep learning-based object detection10.1109/ACCESS.2019.2939201 ↗
14. Wang, H., and Zheng, X. (2019, January 17–19). Survey of Deep Learning Based Object Detection. Proceedings of the 2nd International Conference on Big Data Technologies, Nanjing, China. ICBDT2019.
15. Sharma, L., and Lohan, N. (2019). Internet of things with object detection: Challenges, applications, and solutions. Handbook of Research on Big Data and the IoT, IGI Global.10.4018/978-1-5225-7432-3.ch006 ↗
16. Application of Deep Learning for Object Detection10.1016/j.procs.2018.05.144 ↗
17. A review and an approach for object detection in images10.1504/IJCVR.2017.081234 ↗
18. Distinctive Image Features from Scale-Invariant Keypoints10.1023/B:VISI.0000029664.99615.94 ↗
19. A Review of Yolo Algorithm Developments10.1016/j.procs.2022.01.135 ↗
20. Selective search for object recognition10.1007/s11263-013-0620-5 ↗
21. Spatial pyramid pooling in deep convolutional networks for visual recognition10.1109/TPAMI.2015.2389824 ↗
22. Ding, X., Zhang, X., Ma, N., Han, J., Ding, G., and Sun, J. (2021, January 20–25). Repvgg: Making vgg-style convnets great again. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01352 ↗
23. Zhang, X., Zeng, H., Guo, S., and Zhang, L. (2022). Efficient Long-Range Attention Network for Image Super-resolution. arXiv.10.1007/978-3-031-19790-1_39 ↗
24. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2021, January 20–25). Scaled-yolov4: Scaling cross stage partial network. Proceedings of the IEEE/cvf Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01283 ↗
25. Dalal, N., and Triggs, B. (2005, January 20–25). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, USA.
26. Sivic, J., and Zisserman, A. (2003, January 14–17). Video Google: A text retrieval approach to object matching in videos. Proceedings of the 9th IEEE International Conference on Computer Vision, Nice, France.10.1109/ICCV.2003.1238663 ↗
27. Yan, J., Lei, Z., Wen, L., and Li, S.Z. (2014). The Fastest Deformable Part Model for Object Detection, IEEE Computer Society. CVPR’14.10.1109/CVPR.2014.320 ↗
28. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA. CVPR ’14.10.1109/CVPR.2014.81 ↗
29. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
30. Girshick, R. (2015, January 7–13). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), IEEE Computer Society, Santiago, Chile. ICCV ’15.10.1109/ICCV.2015.169 ↗
31. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
32. Mask R-CNN10.1109/TPAMI.2018.2844175 ↗
33. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, Faster, Stronger. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
34. Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv.
35. Lin, T., Dollar, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
36. Bochkovskiy, A., Wang, C., and Liao, H.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv.
37. Wang, W., Xie, E., Song, X., Zang, Y., Wang, W., Lu, T., Yu, G., and Shen, C. (November, January 27). Efficient and Accurate Arbitrary-Shaped Text Detection With Pixel Aggregation Network. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.10.1109/ICCV.2019.00853 ↗
38. ERF-YOLO: A YOLO algorithm compatible with fewer parameters and higher accuracy10.1016/j.imavis.2021.104317 ↗
39. Gong, H., Li, H., Xu, K., and Zhang, Y. (2019, January 22–24). Object Detection Based on Improved YOLOv3-tiny. Proceedings of the 2019 Chinese Automation Congress (CAC), Hangzhou, China.10.1109/CAC48633.2019.8996750 ↗
40. Jiang, Z., Zhao, L., Li, S., and Jia, Y. (2020). Real-time object detection method based on improved YOLOv4-tiny. arXiv.
41. CDNet: A real-time and robust crosswalk detection network on Jetson nano based on YOLOv510.1007/s00521-022-07007-9 ↗
42. Karthi, M., Muthulakshmi, V., Priscilla, R., Praveen, P., and Vanisri, K. (2021, January 24–25). Evolution of YOLO-V5 Algorithm for Object Detection: Automated Detection of Library Books and Performace validation of Dataset. Proceedings of the 2021 International Conference on Innovative Computing, Intelligent Communication and Smart Electrical Systems (ICSES), Chennai, India.10.1109/ICSES52305.2021.9633834 ↗
43. Long, X., Deng, K., Wang, G., Zhang, Y., Dang, Q., Gao, Y., Shen, H., Ren, J., Han, S., and Ding, E. (2020). PP-YOLO: An Effective and Efficient Implementation of Object Detector. arXiv.
44. Huang, X., Wang, X., Lv, W., Bai, X., Long, X., Deng, K., Dang, Q., Han, S., Liu, Q., and Hu, X. (2021). PP-YOLOv2: A Practical Object Detector. arXiv.
45. Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). Yolox: Exceeding yolo series in 2021. arXiv.
46. Wang, C.Y., Yeh, I.H., and Liao, H.Y.M. (2021). You only learn one representation: Unified network for multiple tasks. arXiv.
47. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.10.1109/CVPR52729.2023.00721 ↗
48. Zheng, L., Fu, C., and Zhao, Y. (2018). Extend the shallow part of Single Shot MultiBox Detector via Convolutional Neural Network. arXiv.10.1117/12.2503001 ↗
49. Yang, Y. (2020). GC-YOLOv3: You Only Look Once with Global Context Block. Electronics, 9.10.3390/electronics9081235 ↗
50. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
51. Huang, G., Liu, Z., Maaten, L.V.D., and Weinberger, K.Q. (2017, January 21–26). Densely Connected Convolutional Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE Computer Society, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
52. Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 23–27). Generative Adversarial Nets. Proceedings of the 27th International Conference on Neural Information Processing Systems–Volume 2, Bangkok, Thailand. NIPS’14.
53. Walczak, S.M. (2017). Metric Diffusion for Non-compact Foliations: Remarks. Metric Diffusion Along Foliations, Springer International Publishing.10.1007/978-3-319-57517-9 ↗
54. Arjovsky, M., Chintala, S., and Bottou, L. (2017, January 6–11). Wasserstein Generative Adversarial Networks. Proceedings of the 34th International Conference on Machine Learning—Volume 70, Sydney, Australia. ICML’17.
55. Wang, Z., Li, L., Li, L., Pi, J., Li, S., and Zhou, Y. (2020, January 18–20). Object detection algorithm based on improved Yolov3-tiny network in traffic scenes. Proceedings of the 2020 4th CAA International Conference on Vehicular Control and Intelligence (CVCI), Hangzhou, China.10.1109/CVCI51460.2020.9338478 ↗
56. An improved tiny-yolov3 pedestrian detection algorithm10.1016/j.ijleo.2019.02.038 ↗
57. An improved method of Tiny YOLOV310.1088/1755-1315/440/5/052025 ↗
58. An Improved Faster R-CNN for Small Object Detection10.1109/ACCESS.2019.2932731 ↗
59. XAI meets mobile traffic classification: Understanding and improving multimodal deep learning architectures10.1109/TNSM.2021.3098157 ↗