Cross-Modal Images Matching Based Enhancement to MEMS INS for UAV Navigation in GNSS Denied Environments
Source abstract
Abstract
A new cross-modal image matching method is proposed to solve the problem that unmanned aerial vehicles (UAVs) are difficult to navigate in GPS-free environment and night environment. In this algorithm, infrared image or visible image is matched with satellite visible image. The matching process is divided into two steps, namely, coarse matching and fine alignment. Based on the dense structure features, the coarse matching algorithm can realize the position update above 10 Hz with a small amount of computation. Based on the end-to-end matching network, the fine alignment algorithm can align the multi-sensor image with the satellite image under the condition of interference. In order to obtain the position and heading information with higher accuracy, the fusion of the information after visual matching with the inertial information can restrain the divergence of the inertial navigation position error. The experiment shows that it has the advantages of strong anti-interference ability, strong reliability, and low requirements on hardware, which is expected to be applied in the field of unmanned navigation.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Robotic Path Planning Algorithms · UAV Applications and Optimization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Research Institute of Aerospace Technology, Central South University, Changsha 410083, China
College of Computer Science and Technology, Macau University of Science and Technology, Macau 999078, China
College of Aerospace Science and Engineering, National University of Defense Technology, Changsha 410073, China
Funding
National Natural Science Foundation of China
References (34)
Show source-provided references
1. Detailed alluvial fan geomorphology in a high-arctic periglacial environment, Svalbard: Application of unmanned aerial vehicle (UAV) surveys10.1080/17445647.2019.1611498 ↗
2. Unmanned Aerial Vehicles (UAVs): A Survey on Civil Applications and Key Research Challenges10.1109/ACCESS.2019.2909530 ↗
3. Zhang, Y., Ma, G., and Wu, J. (2022). Air-Ground Multi-Source Image Matching Based on High-Precision Reference Image. Remote Sens., 14.10.3390/rs14030588 ↗
4. Jahromi, A.J., Broumandan, A., Daneshmand, S., Lachapelle, G., and Ioannides, R.T. (2016, January 28–30). Galileo signal authenticity verification using signal quality monitoring methods. Proceedings of the 2016 International Conference on Localization and GNSS (ICL-GNSS), Barcelona, Spain.10.1109/ICL-GNSS.2016.7533684 ↗
5. UGV-to-UAV cooperative ranging for robust navigation in GNSS-challenged environments10.1016/j.ast.2017.09.024 ↗
6. Kim, Y., and Hwang, D.-H. (2016). Vision/INS Integrated Navigation System for Poor Vision Navigation Environments. Sensors, 16.10.3390/s16101672 ↗
7. Stereo-Vision-Aided Inertial Navigation for Automotive Applications10.1109/LSENS.2021.3049503 ↗
8. Yol, A., Delabarre, B., Dame, A., Dartois, J.É., and Marchand, E. (2014, January 14–18). Vision-based absolute localization for unmanned aerial vehicles. Proceedings of the 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA.10.1109/IROS.2014.6943040 ↗
9. Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity10.1109/TGRS.2017.2656380 ↗
10. Park, J.H., Nam, W.J., and Lee, S.W. (2020). A Two-Stream Symmetric Network with Bidirectional Ensemble for Aerial Image Matching. Remote Sens., 12.10.3390/rs12030465 ↗
11. Shan, M., Wang, F., Lin, F., Gao, Z., Tang, Y.Z., and Chen, B.M. (2015, January 6–9). Google map aided visual navigation for UAVs in GPS-denied environment. Proceedings of the 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO), Zhuhai, China.10.1109/ROBIO.2015.7418753 ↗
12. Barron, J.L., Fleet, D.J., Beauchemin, S.S., and Burkitt, T.A. (1992, January 15–18). Performance of optical flow techniques. Proceedings of the 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Champaign, IL, USA.
13. Lai, T. (2022). A Review on Visual-SLAM: Advancements from Geometric Modelling to Learning-Based Semantic Scene Understanding Using Multi-Modal Sensor Fusion. Sensors, 22.10.3390/s22197265 ↗
14. VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator10.1109/TRO.2018.2853729 ↗
15. Qin, T., Li, P., and Shen, S. (2018, January 21–25). Relocalization, Global Optimization and Map Merging for Monocular Visual-Inertial SLAM. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.10.1109/ICRA.2018.8460780 ↗
16. A Novel Feedback Mechanism-Based Stereo Visual-Inertial SLAM10.1109/ACCESS.2019.2946352 ↗
17. Tightly-Coupled Magneto-Visual-Inertial Fusion for Long Term Localization in Indoor Environment10.1109/LRA.2021.3136241 ↗
18. The YTU dataset and recurrent neural network based visual-inertial odometry10.1016/j.measurement.2021.109878 ↗
19. ORB-SLAM: A Versatile and Accurate Monocular SLAM System10.1109/TRO.2015.2463671 ↗
20. Wang, Y.M., Li, Y., and Zheng, J.B. (2010, January 23–25). A camera calibration technique based on OpenCV. Proceedings of the 3rd International Conference on Information Sciences and Interaction Sciences, Chengdu, China.10.1109/ICICIS.2010.5534797 ↗
21. Pose Estimation for Augmented Reality: A Hands-On Survey10.1109/TVCG.2015.2513408 ↗
22. Dalal, N., and Triggs, B. (2005, January 20–25). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, USA.
23. Nixon, M.S., and Aguado, A. (2012). Feature Extraction & Image Processing for Computer Vision, Academic Press. [3rd ed.].
24. Convolutional Neural Network Architecture for Geometric Matching10.1109/TPAMI.2018.2865351 ↗
25. Chen, Y., Zhang, Q., Zhang, W., and Chen, L. (2021). Bidirectional Symmetry Network with Dual-Field Cyclic Attention for Multi-Temporal Aerial Remote Sensing Image Registration. Symmetry, 13.10.3390/sym13101863 ↗
26. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
27. Liu, S., and Deng, W. (2015, January 3–6). Very deep convolutional neural network based image classification using small training sample size. Proceedings of the 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), Kuala Lumpur, Malaysia.10.1109/ACPR.2015.7486599 ↗
28. Rocco, I., Arandjelovic, R., and Sivic, J. (2018, January 18–23). End-to-End Weakly-Supervised Semantic Alignment. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00723 ↗
29. Random Sample Consensus: A Paradigm for Model Fitting with Applications To Image Analysis and Automated Cartography10.1145/358669.358692 ↗
30. Civilian Vehicle Navigation: Required Alignment of the Inertial Sensors for Acceptable Navigation Accuracies10.1109/TVT.2008.921616 ↗
31. Enhancement of the inertial navigation system for the Morpheus autonomous underwater vehicles10.1109/48.972091 ↗
32. Strapdown Inertial Navigation Integration Algorithm Design Part 2: Velocity and Position Algorithms10.2514/2.4242 ↗
33. Strapdown Inertial Navigation Integration Algorithm Design Part 1: Attitude Algorithms10.2514/2.4228 ↗
34. Yuan, W., Gui, M., and Ning, X. (2017, January 2–4). Initial Attitude Estimation and Installation Errors Calibration of the IMU for Plane by SINS/CNS Integration. Proceedings of the 2017 Chinese Intelligent Automation Conference, Tianjin, China.10.1007/978-981-10-6445-6_14 ↗