Forklift Tracking: Industry 4.0 Implementation in Large-Scale Warehouses through UWB Sensor Fusion
Source abstract
Abstract
This article addresses the problem of determining the location of pallets carried by forklifts inside a warehouse, which are recognized thanks to an onboard Radio Frequency IDentification (RFID) system at the ultra-high-frequency (UHF) band. By reconstructing the forklift trajectory and orientation, the location of the pallets can be associated with the forklift position at the time of unloading events. The localization task is accomplished by means of an easy-to-deploy combination of onboard sensors, i.e., an inertial measurement unit (IMU) and an optical flow sensor (OFS), with a commercial ultra-wideband (UWB) system through an Unscented Kalman Filter (UKF) algorithm, which estimates the forklift pose over time. The proposed sensor fusion approach contributes to the localization error mitigation by preventing drifts in the trajectory reconstruction. The designed methos was at first evaluated by means of a simulation framework and then through an experimental analysis conducted in a large warehouse with a size of about 4000 m2.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Indoor and Outdoor Localization Technologies · Robotics and Sensor-Based Localization · RFID technology advancements
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Information Engineering, University of Pisa, 56122 Pisa, Italy
Department of Energy, Systems, Territory and Constructions Engineering, University of Pisa, 56122 Pisa, Italy
Institute of Electronics, Computer and Telecommunication Engineering (IEIIT), Italian National Research Council (CNR), 10129 Turin, Italy
Funding
Regione Toscana, Italy
References (70)
Show source-provided references
1. A Survey of Enabling Technologies for Network Localization, Tracking, and Navigation10.1109/COMST.2018.2855063 ↗
2. Nepa, P., Motroni, A., Congi, A., Ferro, E.M., Pesi, M., Giorgi, G., Buffi, A., Lazzarotti, M., Bellucci, J., and Galigani, S. (2019, January 9–12). I-READ 4.0: Internet-of-READers for an efficient asset management in large warehouses with high stock rotation index. Proceedings of the 2019 IEEE 5th International forum on Research and Technology for Society and Industry (RTSI), Firenze, Italy.10.1109/RTSI.2019.8895574 ↗
3. Kahraman, C., and Çevik Onar, S. (2015). Intelligent Algorithms for Warehouse Management. Intelligent Techniques in Engineering Management: Theory and Applications, Springer International Publishing.10.1007/978-3-319-17906-3 ↗
4. Joint RFID and UWB Technologies in Intelligent Warehousing Management System10.1109/JIOT.2020.2998484 ↗
5. Decentralized Control of Multi-AGV Systems in Autonomous Warehousing Applications10.1109/TASE.2016.2603781 ↗
6. Recent Advances in Indoor Localization: A Survey on Theoretical Approaches and Applications10.1109/COMST.2016.2632427 ↗
7. Ranging-Free UHF-RFID Robot Positioning Through Phase Measurements of Passive Tags10.1109/TIM.2019.2960900 ↗
8. Lou, L., Xu, X., Cao, J., Chen, Z., and Xu, Y. (2011, January 20–22). Sensor fusion-based attitude estimation using low-cost MEMS-IMU for mobile robot navigation. Proceedings of the 2011 6th IEEE Joint International Information Technology and Artificial Intelligence Conference, Chongqing, China.10.1109/ITAIC.2011.6030374 ↗
9. Dorigoni, D., and Fontanelli, D. (2021, January 17–20). An Uncertainty-driven Analysis for Delayed Mapping SLAM. Proceedings of the 2021 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), Glasgow, UK.10.1109/I2MTC50364.2021.9459876 ↗
10. Lee, S., and Song, J.B. (May, January 26). Robust mobile robot localization using optical flow sensors and encoders. Proceedings of the IEEE International Conference on Robotics and Automation, ICRA ’04. 2004, New Orleans, LA, USA.
11. Ursel, T., and Olinski, M. (2021). Displacement Estimation Based on Optical and Inertial Sensor Fusion. Sensors, 21.10.3390/s21041390 ↗
12. Yu, J.X., Cai, Z.X., and Duan, Z.H. (2008, January 12–15). Dead reckoning of mobile robot in complex terrain based on proprioceptive sensors. Proceedings of the 2008 International Conference on Machine Learning and Cybernetics, Kunming, China.
13. Development and experimental validation of an adaptive extended Kalman filter for the localization of mobile robots10.1109/70.760343 ↗
14. Yin, M.T., and Lian, F.L. (2010, January 18–21). Robot localization and mapping by matching the environmental features from proprioceptive and exteroceptive sensors. Proceedings of the SICE Annual Conference 2010, Taipei, Taiwan.
15. Design and Characterization of a Portable Ultrasonic Indoor 3-D Positioning System10.1109/TIM.2015.2427892 ↗
16. Comuniello, A., De Angelis, A., and Moschitta, A. (2020, January 25–28). A low-cost TDoA-based ultrasonic positioning system. Proceedings of the 2020 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), Dubrovnik, Croatia.10.1109/I2MTC43012.2020.9129061 ↗
17. Human Position Estimation Based on Filtered Sonar Scan Matching: A Novel Localization Approach Using DENCLUE10.1109/JSEN.2020.3048396 ↗
18. Visual Odometry [Tutorial]10.1109/MRA.2011.943233 ↗
19. Hess, W., Kohler, D., Rapp, H., and Andor, D. (2016, January 16–21). Real-time loop closure in 2D LIDAR SLAM. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.10.1109/ICRA.2016.7487258 ↗
20. Behrje, U., Himstedt, M., and Maehle, E. (2018, January 18–21). An Autonomous Forklift with 3D Time-of-Flight Camera-Based Localization and Navigation. Proceedings of the 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV), Singapore.10.1109/ICARCV.2018.8581085 ↗
21. Consistent EKF-Based Visual-Inertial Odometry on Matrix Lie Group10.1109/JSEN.2018.2808330 ↗
22. Flueratoru, L., Simona Lohan, E., Nurmi, J., and Niculescu, D. (2020, January 5–7). HTC Vive as a Ground-Truth System for Anchor-Based Indoor Localization. Proceedings of the 2020 12th International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), Brno, Czech Republic.10.1109/ICUMT51630.2020.9222439 ↗
23. Wang, F., Lü, E., Wang, Y., Qiu, G., and Lu, H. (2020). Efficient Stereo Visual Simultaneous Localization and Mapping for an Autonomous Unmanned Forklift in an Unstructured Warehouse. Appl. Sci., 10.10.3390/app10020698 ↗
24. An Indoor AC Magnetic Positioning System10.1109/TIM.2014.2381353 ↗
25. Analysis of Nonideal Effects and Performance in Magnetic Positioning Systems10.1109/TIM.2016.2608425 ↗
26. MagIK: A Hand-Tracking Magnetic Positioning System Based on a Kinematic Model of the Hand10.1109/TIM.2021.3065761 ↗
27. Indoor Intelligent Mobile Robot Localization Using Fuzzy Compensation and Kalman Filter to Fuse the Data of Gyroscope and Magnetometer10.1109/TIE.2015.2416692 ↗
28. Superior Path Planning Mechanism for Mobile Beacon-Assisted Localization in Wireless Sensor Networks10.1109/JSEN.2014.2322958 ↗
29. Robust Indoor Positioning Provided by Real-Time RSSI Values in Unmodified WLAN Networks10.1109/JSTSP.2009.2029191 ↗
30. Spread-Spectrum Based Ranging of Passive UHF EPC RFID Tags10.1109/LCOMM.2015.2469664 ↗
31. Localizing WiFi Access Points Using Signal Strength10.1109/LCOMM.2011.121410.101379 ↗
32. Preusser, K., and Schmeink, A. (2021). Robust Channel Modelling of 2.4 GHz and 5 GHz Indoor Measurements: Empirical, Ray Tracing and Artificial Neural Network Models. IEEE Trans. Antennas Propag.10.1109/TAP.2021.3098558 ↗
33. Biswas, J., and Veloso, M. (2010, January 3–8). WiFi localization and navigation for autonomous indoor mobile robots. Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.10.1109/ROBOT.2010.5509842 ↗
34. A Survey on Indoor Vehicle Localization Through RFID Technology10.1109/ACCESS.2021.3052316 ↗
35. Sensor Fusion and Tracking Method for Indoor Vehicles With Low-Density UHF-RFID Tags10.1109/TIM.2020.3027926 ↗
36. Comparing Ubisense, BeSpoon, and DecaWave UWB Location Systems: Indoor Performance Analysis10.1109/TIM.2017.2681398 ↗
37. UWB Localization in a Smart Factory: Augmentation Methods and Experimental Assessment
38. Characterization and Modeling of an Experimental UWB Pulse-Based Distance Measurement System10.1109/TIM.2008.2009204 ↗
39. A Low-Cost Ultra-Wideband Indoor Ranging System10.1109/TIM.2009.2020834 ↗
40. Numerical Investigation of an UWB Localization Technique for Unmanned Aerial Vehicles in Outdoor Scenarios10.1109/JSEN.2017.2684817 ↗
41. Ghanem, E., O’Keefe, K., and Klukas, R. (December, January 18). Testing Vehicle-to-Vehicle Relative Position and Attitude Estimation using Multiple UWB Ranging. Proceedings of the 2020 IEEE 92nd Vehicular Technology Conference (VTC2020-Fall), Victoria, BC, Canada.10.1109/VTC2020-Fall49728.2020.9348731 ↗
42. Single-Anchor Positioning: Multipath Processing with Non-Coherent Directional Measurements10.1109/ACCESS.2020.2993197 ↗
43. A Belief Propagation Algorithm for Multipath-Based SLAM10.1109/TWC.2019.2937781 ↗
44. Non-Line-of-Sight Identification and Mitigation Using Received Signal Strength10.1109/TWC.2014.2372341 ↗
45. A Novel NLOS Mitigation Algorithm for UWB Localization in Harsh Indoor Environments10.1109/TVT.2018.2883810 ↗
46. A Semi-Supervised Learning Approach for UWB Ranging Error Mitigation10.1109/LWC.2020.3046531 ↗
47. A Machine Learning Approach to Ranging Error Mitigation for UWB Localization10.1109/TCOMM.2012.042712.110035 ↗
48. Zhang, H., Zhang, Z., Zhao, R., Lu, J., Wang, Y., and Jia, P. (2021, January 12–14). Review on UWB-based and multi-sensor fusion positioning algorithms in indoor environment. Proceedings of the 2021 IEEE 5th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China.10.1109/IAEAC50856.2021.9390630 ↗
49. Kolakowski, M., Djaja-Josko, V., and Kolakowski, J. (2020). Static LiDAR Assisted UWB Anchor Nodes Localization. IEEE Sens. J.
50. Range-Focused Fusion of Camera-IMU-UWB for Accurate and Drift-Reduced Localization10.1109/LRA.2021.3057838 ↗
51. Sadruddin, H., Mahmoud, A., and Atia, M. (2019, January 27–30). An Indoor Navigation System using Stereo Vision, IMU and UWB Sensor Fusion. Proceedings of the 2019 IEEE SENSORS, Montreal, QC, Canada.10.1109/SENSORS43011.2019.8956942 ↗
52. Tightly Coupled Integration of INS and UWB Using Fixed-Lag Extended UFIR Smoothing for Quadrotor Localization10.1109/JIOT.2020.3015351 ↗
53. Lidar/UWB Fusion Based SLAM With Anti-Degeneration Capability10.1109/TVT.2020.3045767 ↗
54. UWB/Lidar Coordinate Matching Method with Anti-Degeneration Capability10.1109/JSEN.2020.3023738 ↗
55. Magnago, V., Corbalán, P., Picco, G.P., Palopoli, L., and Fontanelli, D. (2019, January 3–8). Robot Localization via Odometry-assisted Ultra-wideband Ranging with Stochastic Guarantees. Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.10.1109/IROS40897.2019.8968019 ↗
56. An Uncertainty-Driven and Observability-Based State Estimator for Nonholonomic Robots
57. Kalman-Filter-Based Integration of IMU and UWB for High-Accuracy Indoor Positioning and Navigation10.1109/JIOT.2020.2965115 ↗
58. A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking10.1109/78.978374 ↗
59. Unscented filtering and nonlinear estimation10.1109/JPROC.2003.823141 ↗
60. Wan, E., and Van Der Merwe, R. (2000, January 4). The unscented Kalman filter for nonlinear estimation. Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373), Lake Louise, AB, Canada.
61. (2021, October 09). Decawave MDEK1001 Evaluation Kit. Available online: https://www.decawave.com/product/mdek1001-deployment-kit/.
62. (2021, October 09). Avago ADNS-3080 Optical Flow Sensor. Available online: https://datasheet.octopart.com/ADNS-3080-Avago-datasheet-10310392.pdf/.
63. (2021, October 09). STMicroelectronics VL53L0X Laser-Ranging Distance Sensors. Available online: https://www.st.com/en/imaging-and-photonics-solutions/vl53l0x.html.
64. (2021, October 09). STMicroelectronics LSMDS3 Inertial Measurement Unit Platform. Available online: https://www.st.com/en/mems-and-sensors/lsm6ds3.html/.
65. (2021, October 09). RENESAS SK-S7G2 Microcontroller. Available online: https://www.renesas.com/us/en/products/microcontrollers-microprocessors/renesas-synergy-platform-mcus/yssks7g2e30-sk-s7g2-starter-kit.
66. (2021, October 09). UHF-RFID Reader Impinj Speedway Revolution R420. Available online: https://support.impinj.com/hc/en-us/articles/202755388-Impinj-Speedway-RAIN-RFID-Reader-Family-Product-Brief-Datasheet.
67. (2021, October 09). UHF-RFID Keonn Advantenna-p11 Antenna. Available online: https://keonn.com/components-product/advantenna-p11/.
68. (2021, October 09). UHF-RFID Alien A0501 Antenna. Available online: https://www.alientechnology.com/products/antennas/alr-a0501/.
69. (2021, October 09). Leica Flexline TS03 Manual Total Station. Available online: https://leica-geosystems.com/it-it/products/total-stations/manual-total-stations/leica-flexline-ts03.
70. Salvador, C., Zani, F., and Biffi Gentili, G. (2011, January 15–16). RFID and sensor network technologies for safety managing in hazardous environments. Proceedings of the 2011 IEEE International Conference on RFID-Technologies and Applications, Sitges, Spain.10.1109/RFID-TA.2011.6068618 ↗