journal article·2020-09

A robust visual SLAM system in dynamic man-made environments

JiaCheng Liu, ZiYang Meng, Zheng You

Publisher page

Abstract

This paper presents a robust visual simultaneous localization and mapping (SLAM) system that leverages point and structural line features in dynamic man-made environments. Manhanttan world assumption is considered and the structural line features in such man-made environments provide rich geometric constraint, e.g., parallelism. Such a geometric constraint can be therefore used to rectify 3D maplines after initialization. To cope with dynamic scenarios, the proposed system are divided into four main threads including 2D dynamic object tracking, visual odometry, local mapping and loop closing. The 2D tracker is responsible to track the object and capture the moving object in bounding boxes. In such a case, the dynamic background can be excluded and the outlier point and line features can be effectively removed. To parameterize 3D lines, we use Plucker line coordinates in initialization and projection processes, and utilize the orthonormal representation in unconstrained graph optimization process. The proposed system has been evaluated in both benchmark datasets and real-world scenarios, which reveals a more robust performance in most of the experiments compared with the existing state-of-the-art methods.
Source: openaire · Quality: candidate unverified · Source record ↗

Research context

OpenAlex topics: Robotics and Sensor-Based Localization · 3D Surveying and Cultural Heritage · Advanced Image and Video Retrieval Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (29)

Show source-provided references
1. Strasdat H, Montiel J M M, Davison A J. Visual SLAM: Why filter? Image Vision Comput, 2012, 30: 65–7710.1016/j.imavis.2012.02.009 ↗
2. Bescos B, Facil J M, Civera J, et al. DynaSLAM: Tracking, mapping, and inpainting in dynamic scenes. IEEE Robot Autom Lett, 2018, 3: 4076–408310.1109/LRA.2018.2860039 ↗
3. Yu C, Liu Z, Liu X, et al. DS-SLAM: A semantic visual SLAM towards dynamic environments. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. Madrid, 2018. 1168–117410.1109/IROS.2018.8593691 ↗
4. Coughlan J, Yuille A. Manhattan world: Compass direction from a single image by Bayesian inference. In: IEEE International Conference on Computer Vision. Kerkyra, 1999. 941–94710.1109/ICCV.1999.790349 ↗
5. Zhou H, Zou D, Pei L, et al. StructSLAM: Visual SLAM with building structure lines. IEEE Trans Veh Technol, 2015, 64: 1364–137510.1109/TVT.2015.2388780 ↗
6. Zou D, Wu Y, Pei L, et al. StructVIO: Visual-inertial odometry with structural regularity of man-made environments. IEEE Trans Robot, 2019, 35: 999–101310.1109/TRO.2019.2915140 ↗
7. Li H, Yao J, Bazin J, et al. A monocular SLAM system leveraging structural regularity in Manhattan world. In: IEEE International Conference on Robotics and Automation. Brisbane, 2018. 2518–252510.1109/ICRA.2018.8463165 ↗
8. Bartoli A, Sturm P. Structure-from-motion using lines: Representation, triangulation, and bundle adjustment. Comput Vision Image Understand, 2005, 100: 416–44110.1016/j.cviu.2005.06.001 ↗
9. Pumarola A, Vakhitov A, Agudo A, et al. PL-SLAM: Real-time monocular visual SLAM with points and lines. In: IEEE International Conference on Robotics and Automation. Singapore, 2017. 4503450810.1109/ICRA.2017.7989522 ↗
10. Gomez-Ojeda R, Moreno F A, Zuniga-Noel D, et al. PL-SLAM: A stereo SLAM system through the combination of points and line segments. IEEE Trans Robot, 2019, 35: 734–74610.1109/TRO.2019.2899783 ↗
11. Gomez-Ojeda R, Briales J, González-Jiménez J. PL-SVO: Semidirect monocular visual odometry by combining points and line segments. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. Daejeon, 2016. 4211–421610.1109/IROS.2016.7759620 ↗
12. Zheng F, Tsai G, Zhang Z, et al. Trifo-VIO: Robust and efficient stereo visual inertial odometry using points and lines. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. Madrid, 2018. 3686–369310.1109/IROS.2018.8594354 ↗
13. Zhang G, Lee J H, Lim J, et al. Building a 3-D line-based map using stereo SLAM. IEEE Trans Robot, 2015, 31: 1364–137710.1109/TRO.2015.2489498 ↗
14. Zuo X, Xie X, Liu Y, et al. Robust visual SLAM with point and line features. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. Vancouver, 2017. 1775–178210.1109/IROS.2017.8205991 ↗
15. Schindler G, Dellaert F. Atlanta world: An expectation maximization framework for simultaneous low-level edge grouping and camera calibration in complex man-made environments. In: IEEE Conference on Computer Vision and Pattern Recognition. Washington, 2004. 203–209
16. Mur-Artal R, Tardos J D. ORB-SLAM2: An open-source SLAM system for monocular, stereo, and RGB-D cameras. IEEE Trans Robot, 2017, 33: 1255–126210.1109/TRO.2017.2705103 ↗
17. Qiu K, Qin T, Gao W, et al. Tracking 3-D motion of dynamic objects using monocular visual-inertial sensing. IEEE Trans Robot, 2019, 35: 799–81610.1109/TRO.2019.2909085 ↗
18. Yang S, Scherer S. CubeSLAM: Monocular 3-D object SLAM. IEEE Trans Robot, 2019, 35: 925–93810.1109/TRO.2019.2909168 ↗
19. Eckenhoff K, Yang Y, Geneva P, et al. Tightly-coupled visual-inertial localization and 3-D rigid-body target tracking. IEEE Robot Autom Lett, 2019, 4: 1541–154810.1109/LRA.2019.2896472 ↗
20. Galvez-López D, Tardos J D. Bags of binary words for fast place recognition in image sequences. IEEE Trans Robot, 2012, 28: 1188–119710.1109/TRO.2012.2197158 ↗
21. Hare S, Golodetz S, Saffari A, et al. Struck: Structured output tracking with kernels. IEEE Trans Pattern Anal Mach Intell, 2016, 38: 2096–210910.1109/TPAMI.2015.2509974 ↗
22. Rublee E, Rabaud V, Konolige K, et al. ORB: An efficient alternative to SIFT or SURF. In: IEEE International Conference on Computer Vision. Barcelona, 2011. 2564–257110.1109/ICCV.2011.6126544 ↗
23. von Gioi R G, Jakubowicz J, Morel J M, et al. LSD: A fast line segment detector with a false detection control. IEEE Trans Pattern Anal Mach Intell, 2010, 32: 722–73210.1109/TPAMI.2008.300 ↗
24. Lu X, Yao J, Li H, et al. 2-line exhaustive searching for real-time vanishing point estimation in Manhattan world. In: IEEE Winter Conference on Applications of Computer Vision. California, 2017. 345–35310.1109/WACV.2017.45 ↗
25. Zhang L, Koch R. An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency. J Visual Commun Image Represent, 2013, 24: 794–80510.1016/j.jvcir.2013.05.006 ↗
26. Kuemmerle R, Grisetti G, Strasdat H, et al. G2o: A general framework for graph optimization. In: IEEE International Conference on Robotics and Automation. Shanghai, 2011. 3607–361310.1109/ICRA.2011.5979949 ↗
27. Burri M, Nikolic J, Gohl P, et al. The EuRoC micro aerial vehicle datasets. Int J Robot Res, 2016, 35: 1157–116310.1177/0278364915620033 ↗
28. Geiger A, Lenz P, Urtasun R. Are we ready for autonomous driving? The KITTI vision benchmark suite. In: IEEE Conference on Computer Vision and Pattern Recognition. Providence RI, 2012. 3354–336110.1109/CVPR.2012.6248074 ↗
29. Bonarini A, Burgard W, Fontana G, et al. RAWSEEDS: Robotics advancement through web-publishing of sensorial and elaborated extensive data sets. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. Beijing, 2006. 16–23