journal article·2020-10-07Open access

Field-Applicable Pig Anomaly Detection System Using Vocalization for Embedded Board Implementations

Minki Hong, Hanse Ahn, Othmane Atif, Jonguk Lee, Daihee Park, Yongwha Chung

Applied Sciences· Volume 10· Issue 19

Abstract

Failure to quickly and accurately detect abnormal situations, such as the occurrence of infectious diseases, in pig farms can cause significant damage to the pig farms and the pig farming industry of the country. In this study, we propose an economical and lightweight sound-based pig anomaly detection system that can be applicable even in small-scale farms. The system consists of a pipeline structure, starting from sound acquisition to abnormal situation detection, and can be installed and operated in an actual pig farm. It has the following structure that makes it executable on the embedded board TX-2: (1) A module that collects sound signals; (2) A noise-robust preprocessing module that detects sound regions from signals and converts them into spectrograms; and (3) A pig anomaly detection module based on MnasNet, a lightweight deep learning method, to which the 8-bit filter clustering method proposed in this study is applied, reducing its size by 76.3% while maintaining its identification performance. The proposed system recorded an F1-score of 0.947 as a stable pig’s abnormality identification performance, even in various noisy pigpen environments, and the system’s execution time allowed it to perform in real time.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Food Supply Chain Traceability · Animal Behavior and Welfare Studies · Advanced Chemical Sensor Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Information Science, Korea University, Sejong Campus, Sejong City 30019, Korea

Department of Computer Convergence Software, Korea University, Sejong Campus, Sejong City 30019, Korea

References (46)

Show source-provided references
1. MAFRA (Ministry of Agriculture, Food and Rural Affairs) (2020, May 24). Agricultural and Forestry Production Index. (In Korean). Available online: https://www.mafra.go.kr/marfa/357/subview.do.
2. Stress detection and classification of laying hens by sound analysis10.5713/ajas.14.0654 ↗
3. Precision livestock farming: Building ‘digital representations’ to bring the animals closer to the farmer10.1017/S175173111900199X ↗
4. Liu, L., Li, B., Zhao, R., Yao, W., Shen, M., and Yang, J. (2020). A novel method for broiler abnormal sound detection using WMFCC and HMM. J. Sensor, 1–7.10.1155/2020/2985478 ↗
5. Method for detecting avian influenza disease of chickens based on sound analysis10.1016/j.biosystemseng.2019.01.015 ↗
6. Automatic detection of cow’s oestrus in audio surveillance system10.5713/ajas.2012.12628 ↗
7. Early recognition of bovine respiratory disease in calves using automated continuous monitoring of cough sounds10.1016/j.compag.2016.07.014 ↗
8. Automatic cough detection for bovine respiratory disease in a calf house10.1016/j.biosystemseng.2018.06.018 ↗
9. Field test of algorithm for automatic cough detection in pig houses10.1016/j.compag.2007.08.016 ↗
10. Real-time recognition of sick pig cough sounds10.1016/j.compag.2008.02.010 ↗
11. The influence of respiratory disease on the energy envelope dynamics of pig cough sounds10.1016/j.compag.2009.07.002 ↗
12. Classification of porcine wasting diseases using sound analysis10.5713/ajas.2010.90483 ↗
13. Automatic detection and recognition of pig wasting diseases using sound data in audio surveillance systems10.3390/s131012929 ↗
14. Vandermeulen, J., Bahr, C., Tullo, E., Fontana, I., Ott, S., Kashiha, M., and Berckmans, D. (2015). Discerning pig screams in production environments. PLoS ONE, 10.10.1371/journal.pone.0123111 ↗
15. Use of vocalisation to identify sex, age, and distress in pig production10.1016/j.biosystemseng.2018.03.007 ↗
16. Cough sound analysis to assess air quality in commercial weaner barns10.1016/j.compag.2019.03.001 ↗
17. Lee, J., Jin, L., Park, D., and Chung, Y. (2016). Automatic recognition of aggressive behavior in pigs using a kinect depth sensor. Sensors, 16.10.3390/s16050631 ↗
18. Voice activity detection using an adaptive context attention model10.1109/LSP.2018.2811740 ↗
19. An overview of speech endpoint detection algorithms10.1016/j.apacoust.2019.107133 ↗
20. New interactive strategies for virtual reality streaming in degraded context of use10.1016/j.cag.2019.10.005 ↗
21. An inaudible voice attack to context-based device authentication in smart IoT systems10.1016/j.sysarc.2019.101696 ↗
22. Tan, M., Chen, B., Pang, R., Vasudevan, V., Sandler, M., Howard, A., and Le, Q.V. (2019, January 18–23). MnasNet: Platform-aware neural architecture search for mobile. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00293 ↗
23. Very deep convolutional neural networks for noise robust speech recognition10.1109/TASLP.2016.2602884 ↗
24. Pervaiz, A., Hussain, F., Israr, H., Tahir, M.A., Raja, F.R., Baloch, N.K., and Zikria, Y.B. (2020). Incorporating noise robustness in speech command recognition by noise augmentation of training data. Sensors, 20.10.3390/s20082326 ↗
25. Noise robust sound event classification with convolutional neural network10.1016/j.neucom.2017.07.021 ↗
26. NVIDIA (2020, June 30). NVIDIA Jetson TX2. Available online: http://www.nvidia.com/object/embedded-systems-dev-kits-modules.html.
27. Roy, S.S., Rodrigues, N., and Taguchi, Y. (2020). Incremental dilations using CNN for brain tumor classification. Appl. Sci., 10.10.3390/app10144915 ↗
28. Choi, H.H., Kang, H.S., and Yun, B.J. (2020). CNN-based illumination estimation with semantic information. Appl. Sci., 10.10.3390/app10144806 ↗
29. Seo, J., Ahn, H., Kim, D., Lee, S., Chung, Y., and Park, D. (2020). EmbeddedPigDet—Fast and accurate pig detection for embedded board implementations. Appl. Sci., 10.10.3390/app10082878 ↗
30. Kim, K.I., and Lee, K.M. (2020). Convolutional neural network-based gear type identification from automatic identification system trajectory data. Appl. Sci., 10.10.3390/app10114010 ↗
31. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–23). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
32. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
33. Zoph, B., Vasudevan, V., Shlens, J., and Le, Q.V. (2018, January 18–23). Learning transferable architectures for scalable image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00907 ↗
34. Zoph, B., and Le, Q.V. (2016). Neural architecture search with reinforcement learning. arXiv.
35. Tan, M., and Le, Q.V. (2019). Efficientnet: Rethinking model scaling for convolutional neural networks. arXiv.
36. Yang, T., Howard, A., Chen, B., Zhang, X., Go, A., Sandler, M., Sze, V., and Adam, H. (2018, January 8–14). Netadapt: Platform-aware neural network adaptation for mobile applications. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01249-6_18 ↗
37. Li, H., Kadav, A., Durdanovic, I., Samet, H., and Graf, H.P. (2016). Pruning filters for efficient convnets. arXiv.
38. Hu, Y., Sun, S., Li, J., Wang, X., and Gu, Q.A. (2018). Novel channel pruning method for deep neural network ompression. arXiv.
39. Prakash, A., Storer, J., Florencio, D., and Zhang, C. (2019, January 18–23). RePr: Improved training of convolution filters. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.01092 ↗
40. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
41. He, Y., Dong, X., Kang, G., Fu, Y., Yan, C., and Yang, Y. (2019). Asymptotic soft filter pruning for deep convolutional neural networks. IEEE Trans. Cybern., 3594–3604.10.1109/TCYB.2019.2933477 ↗
42. Chollet, F. (2017, January 21–26). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
43. McFee, B., Raffel, C., Liang, D., Ellis, D.P., McVicar, M., Battenberg, E., and Nieto, O. (2015, January 6–12). librosa: Audio and music signal analysis in python. Proceedings of the 14th Python in Science Conference, Austin, TX, USA.10.25080/Majora-7b98e3ed-003 ↗
44. (2020, May 06). Keras. Available online: https://keras.io.
45. Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., and Kudlur, M. (2016, January 2–4). Tensorflow: A system for large-scale machine learning. Proceedings of the 12th Symposium on Operating Systems Design and Implementation OSDI’ 16, Savannah, GA, USA.
46. Evaluation: From Precision, Recall and F-Factor to ROC, Informedness, Markedness and Correlation