Research on Gesture Recognition System Using Multiple Sensors Based on Earth’s Magnetic Field and 1D Convolution Neural Network
Source abstract
Abstract
A commonly used method of gesture recognition is the use of sensor technology. Typically, technology detecting Earth’s magnetic field is used in indoor positioning, and magnetic detection technology serves as a redundant method for gesture recognition devices. In this paper, we propose a novel system that utilizes multiple sensors measuring Earth’s magnetic field to collect data and perform gesture recognition through a one-dimensional convolutional neural network algorithm. By applying the detection of Earth’s magnetic field to gesture recognition, our system significantly improves the accuracy of recognition through a one-dimensional (1D) neural network algorithm. We conducted experiments where we collected and recognized American Sign Language standard letters, and achieved an accuracy rate close to 97%. Our experimental results demonstrate that this gesture recognition system using magnetic field sensors and a one-dimensional neural network algorithm is feasible for practical applications. Furthermore, our approach reduces the complexity of the device compared to the gesture recognition method based on artificial magnetic fields, while maintaining high recognition accuracy and not limiting the user’s hand movements. This technology holds great promise for the field of human–computer interaction.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Hand Gesture Recognition Systems · Indoor and Outdoor Localization Technologies · Tactile and Sensory Interactions
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
Funding
National Natural Science Foundation of China
References (35)
Show source-provided references
1. Naglot, D., and Kulkarni, M. (2016, January 26–27). Real Time Sign Language Recognition Using the Leap Motion Controller. Proceedings of the International Conference on Inventive Computation Technologies (ICICT), Coimbatore, India.10.1109/INVENTIVE.2016.7830097 ↗
2. Dong, C., Leu, M.C., and Yin, Z. (2015, January 7–12). American Sign Language Alphabet Recognition Using Microsoft Kinect. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Boston, MA, USA.
3. ASL-3DCNN: American Sign Language Recognition Technique Using 3-D Convolutional Neural Networks. Multimed10.1007/s11042-021-10768-5 ↗
4. Pansare, J.R., and Ingle, M. (2016, January 3–5). Vision-Based Approach for American Sign Language Recognition Using Edge Orientation Histogram. Proceedings of the International Conference on Image, Vision and Computing (ICIVC), Portsmouth, UK.10.1109/ICIVC.2016.7571278 ↗
5. A Review of the Hand Gesture Recognition System: Current Progress and Future Directions10.1109/ACCESS.2021.3129650 ↗
6. Emerging Wearable Interfaces and Algorithms for Hand Gesture Recognition: A Survey10.1109/RBME.2021.3078190 ↗
7. Savur, C., and Sahin, F. (2016, January 9–12). American Sign Language Recognition System by Using Surface EMG Signal. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary.10.1109/SMC.2016.7844675 ↗
8. Jani, A.B., Kotak, N.A., and Roy, A.K. (2018, January 28–31). Sensor Based Hand Gesture Recognition System for English Alphabets Used in Sign Language of Deaf-Mute People. Proceedings of the IEEE SENSORS, New Delhi, India.10.1109/ICSENS.2018.8589574 ↗
9. Development of a Wearable Device for Sign Language Recognition10.1088/1742-6596/1019/1/012017 ↗
10. Integrated Optical Fiber Force Myography Sensor as Pervasive Predictor of Hand Postures10.1177/1179597220912825 ↗
11. Wen, H., Rojas, J.R., and Dey, A.K. (2016, January 7–12). Serendipity: Finger Gesture Recognition Using an off-the-Shelf Smartwatch. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.10.1145/2858036.2858466 ↗
12. Development of a Fingertip Glove Equipped with Magnetic Tracking Sensors10.3390/s100201119 ↗
13. Chan, T.K., Yu, Y.K., Kam, H.C., and Wong, K.H. (2018, January 18–21). Robust Hand Gesture Input Using Computer Vision, Inertial Measurement Unit (IMU) and Flex Sensors. Proceedings of the IEEE International Conference on Mechatronics, Robotics and Automation (ICMRA), Hefei, China.10.1109/ICMRA.2018.8490559 ↗
14. The Manumeter: A Wearable Device for Monitoring Daily Use of the Wrist and Fingers10.1109/JBHI.2014.2329841 ↗
15. Hand Gesture Recognition Using Multiple Acoustic Measurements at Wrist10.1109/THMS.2020.3041201 ↗
16. Feasibility of Wrist-Worn, Real-Time Hand, and Surface Gesture Recognition via SEMG and IMU Sensing10.1109/TII.2017.2779814 ↗
17. Machine-Learning-Based Hand Motion Recognition System by Measuring Forearm Deformation with a Distance Sensor Array10.1007/s41315-019-00115-1 ↗
18. Hand Gesture Interface Device10.1145/1165387.275628 ↗
19. A Wearable and Wirelessly Powered System for Multiple Finger Tracking10.1109/TIM.2020.2969089 ↗
20. Magnetic Field-Based Positioning Systems10.1109/COMST.2017.2684087 ↗
21. Rinalduzzi, M., De Angelis, A., Santoni, F., Buchicchio, E., Moschitta, A., Carbone, P., Bellitti, P., and Serpelloni, M. (2021). Gesture Recognition of Sign Language Alphabet Using a Magnetic Positioning System. Appl. Sci., 11.10.3390/app11125594 ↗
22. Santoni, F., De Angelis, A., Moschitta, A., and Carbone, P. (2020). A Multi-Node Magnetic Positioning System with a Distributed Data Acquisition Architecture. Sensors, 20.10.3390/s20216210 ↗
23. Development of a Data Glove with Reducing Sensors Based on Magnetic Induction10.1109/TIE.2005.844259 ↗
24. MagIK: A Hand-Tracking Magnetic Positioning System Based on a Kinematic Model of the Hand10.1109/TIM.2021.3065761 ↗
25. Human Behavior in Image-Based Road Health Inspection Systems despite the Emerging AutoML10.1186/s40537-022-00646-8 ↗
26. Siriborvornratanakul, T. (July, January 26). A New Human Factor Study in Developing Practical Vision-Based Applications with the Transformer-Based Deep Learning Model. Proceedings of the International Conference on Human-Computer Interaction, AI-HCI, Virtual Event.
27. Object Detection in 20 Years: A Survey10.1109/JPROC.2023.3238524 ↗
28. Image Segmentation Using Deep Learning: A Survey
29. Richardson, E., Alaluf, Y., Patashnik, O., Nitzan, Y., Azar, Y., Shapiro, S., and Cohen-Or, D. (2021, January 20–25). Encoding in Style: A StyleGAN Encoder for Image-to-Image Translation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00232 ↗
30. A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects10.1109/TNNLS.2021.3084827 ↗
31. Phoneme Recognition Using Time-Delay Neural Networks10.1109/29.21701 ↗
32. Detection of Alzheimer Disease on Online Handwriting Using 1D Convolutional Neural Network10.1109/ACCESS.2022.3232396 ↗
33. A Compact Multi-Branch 1D Convolutional Neural Network for EEG-Based Motor Imagery Classification10.1016/j.bspc.2022.104456 ↗
34. Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by Shift in Position10.1007/BF00344251 ↗
35. Ioffe, S., and Szegedy, C. (2015, January 6–11). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the 32nd International Conference on Machine Learning ICML, Lille, France.