journal article·2019-06-29Open access

Robust Visual-Aided Autonomous Takeoff, Tracking, and Landing of a Small UAV on a Moving Landing Platform for Life-Long Operation

Pablo R. Palafox, Mario Garzón, João Valente, Juan Jesús Roldán, Antonio Barrientos

Applied Sciences· Volume 9· Issue 13

Abstract

Robot cooperation is key in Search and Rescue (SaR) tasks. Frequently, these tasks take place in complex scenarios affected by different types of disasters, so an aerial viewpoint is useful for autonomous navigation or human tele-operation. In such cases, an Unmanned Aerial Vehicle (UAV) in cooperation with an Unmanned Ground Vehicle (UGV) can provide valuable insight into the area. To carry out its work successfully, such as multi-robot system requires the autonomous takeoff, tracking, and landing of the UAV on the moving UGV. Furthermore, it needs to be robust and capable of life-long operation. In this paper, we present an autonomous system that enables a UAV to take off autonomously from a moving landing platform, locate it using visual cues, follow it, and robustly land on it. The system relies on a finite state machine, which together with a novel re-localization module allows the system to operate robustly for extended periods of time and to recover from potential failed landing maneuvers. Two approaches for tracking and landing are developed, implemented, and tested. The first variant is based on a novel height-adaptive PID controller that uses the current position of the landing platform as the target. The second one combines this height-adaptive PID controller with a Kalman filter in order to predict the future positions of the platform and provide them as input to the PID controller. This facilitates tracking and, mainly, landing. Both the system as a whole and the re-localization module in particular have been tested extensively in a simulated environment (Gazebo). We also present a qualitative evaluation of the system on the real robotic platforms, demonstrating that our system can also be deployed on real robotic platforms. For the benefit of the community, we make our software open source.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robotics and Sensor-Based Localization · Robotic Path Planning Algorithms · Advanced Vision and Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Computer Vision & Artificial Intelligence Group, Technical University Munich, Boltzmannstrasse 3, 85748 Garching, Germany

Univ. Grenoble Alpes, INRIA, Grenoble INP, 38000 Grenoble, France

Information Technology Group, Wageningen University & Research, 6708 PB Wageningen, The Netherlands

Centro de Automática y Robótica (UPM-CSIC), Universidad Politécnica de Madrid, José Gutiérrez Abascal, 2, 28006 Madrid, Spain

Funding

Ministry of Economy and Competitiveness of the Government of Spain · Programas de Actividades I+D en la Comunidad de Madrid and Structural Funds of the EU

References (22)

Show source-provided references
1. Robotic Urban Search and Rescue: A Survey from the Control Perspective10.1007/s10846-013-9822-x ↗
2. Cardona, G.A., and Calderon, J.M. (2019). Robot Swarm Navigation and Victim Detection Using Rendezvous Consensus in Search and Rescue Operations. Appl. Sci., 9.10.3390/app9081702 ↗
3. An aerial-ground robotic system for navigation and obstacle mapping in large outdoor areas10.3390/s130101247 ↗
4. Polvara, R., Sharma, S., Wan, J., Manning, A., and Sutton, R. (2018). Vision-Based Autonomous Landing of a Quadrotor on the Perturbed Deck of an Unmanned Surface Vehicle. Drones, 2.10.3390/drones2020015 ↗
5. Roldán, J., Garcia-Aunon, P., Garzón, M., de León, J., del Cerro, J., and Barrientos, A. (2016). Heterogeneous multi-robot system for mapping environmental variables of greenhouses. Sensors, 16.10.3390/s16071018 ↗
6. Reardon, C., and Fink, J. (2016, January 23–27). Air-ground robot team surveillance of complex 3D environments. Proceedings of the 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), Lausanne, Switzerland.10.1109/SSRR.2016.7784322 ↗
7. Borreguero, D., Velasco, O., and Valente, J. (2018). Experimental Design of a Mobile Landing Platform to Assist Aerial Surveys in Fluvial Environments. Appl. Sci., 9.10.3390/app9010038 ↗
8. Koenig, N., and Howard, A. (October, January 28). Design and use paradigms for gazebo, an open-source multi-robot simulator. Proceedings of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No. 04CH37566), Sendai, Japan.
9. Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., and Ng, A.Y. (2009, January 17). ROS: An open-source Robot Operating System. Proceedings of the ICRA Workshop on Open Source Software, Kobe, Japan.
10. Kong, W., Zhou, D., Zhang, D., and Zhang, J. (2014, January 28–29). Vision-based autonomous landing system for unmanned aerial vehicle: A survey. Proceedings of the 2014 International Conference on Multisensor Fusion and Information Integration For Intelligent Systems (MFI), Beijing, China.10.1109/MFI.2014.6997750 ↗
11. Ling, K. (2014). Precision Landing of a Quadrotor UAV on a Moving Target Using Low-Cost Sensors. [Master’s Thesis, University of Waterloo].
12. Lee, D., Ryan, T., and Kim, H.J. (2012, January 14–18). Autonomous landing of a VTOL UAV on a moving platform using image-based visual servoing. Proceedings of the 2012 IEEE International Conference on Robotics and Automation, Saint Paul, MN, USA.10.1109/ICRA.2012.6224828 ↗
13. Saripalli, S., and Sukhatme, G.S. (2006). Landing on a moving target using an autonomous helicopter. Field and Service Robotics, Springer.10.1007/10991459_27 ↗
14. Visual pattern recognition by moment invariants10.1109/TIT.1962.1057692 ↗
15. Macés-Hernández, J.A., Defaÿ, F., and Chauffaut, C. (2017, January 17–20). Autonomous landing of an UAV on a moving platform using Model Predictive Control. Proceedings of the 2017 11th Asian Control Conference (ASCC), Gold Coast, QLD, Australia.10.1109/ASCC.2017.8287533 ↗
16. Feng, Y., Zhang, C., Baek, S., Rawashdeh, S., and Mohammadi, A. (2018). Autonomous Landing of a UAV on a Moving Platform Using Model Predictive Control. Drones, 2.10.3390/drones2040034 ↗
17. Almeshal, A., and Alenezi, M. (2018). A Vision-Based Neural Network Controller for the Autonomous Landing of a Quadrotor on Moving Targets. Robotics, 7.10.3390/robotics7040071 ↗
18. Yang, T., Ren, Q., Zhang, F., Xie, B., Ren, H., Li, J., and Zhang, Y. (2018). Hybrid Camera Array-Based UAV Auto-Landing on Moving UGV in GPS-Denied Environment. Remote Sens., 10.10.3390/rs10111829 ↗
19. German Aerospace Center (2019, May 29). Autonomous Landing at Full Speed. Available online: https://www.dlr.de/dlr/en/desktopdefault.aspx/tabid-10080/150_read-16413/#/gallery/21679.
20. Bradski, G. (2019, May 29). The OpenCV Library. Available online: http://www.drdobbs.com/open-source/the-opencv-library/184404319.
21. Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.10.1017/CBO9780511811685 ↗
22. Garzón, M., Garzón-Ramos, D., Barrientos, A., and Cerro, J.D. (2016, January 29–31). Pedestrian Trajectory Prediction in Large Infrastructures. Proceedings of the 13th International Conference on Informatics in Control, Automation and Robotics, Lisbon, Portugal.10.5220/0005983303810389 ↗