journal article·2020-04-08Open access

Adaptive Human–Machine Evaluation Framework Using Stochastic Gradient Descent-Based Reinforcement Learning for Dynamic Competing Network

Jinbae Kim, Hyunsoo Lee

Applied Sciences· Volume 10· Issue 7

Abstract

Complex problems require considerable work, extensive computation, and the development of effective solution methods. Recently, physical hardware- and software-based technologies have been utilized to support problem solving with computers. However, problem solving often involves human expertise and guidance. In these cases, accurate human evaluations and diagnoses must be communicated to the system, which should be done using a series of real numbers. In previous studies, only binary numbers have been used for this purpose. Hence, to achieve this objective, this paper proposes a new method of learning complex network topologies that coexist and compete in the same environment and interfere with the learning objectives of the others. Considering the special problem of reinforcement learning in an environment in which multiple network topologies coexist, we propose a policy that properly computes and updates the rewards derived from quantitative human evaluation and computes together with the rewards of the system. The rewards derived from the quantitative human evaluation are designed to be updated quickly and easily in an adaptive manner. Our new framework was applied to a basketball game for validation and demonstrated greater effectiveness than the existing methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Reinforcement Learning in Robotics · Mobile Crowdsensing and Crowdsourcing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Industrial Engineering, Kumoh National Institute of Technology, Gumi 39177, Korea

Funding

Priority Research Centers Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology

References (27)

Show source-provided references
1. Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press.
2. Knox, W.B., and Stone, P. (2008, January 9–12). Tamer: Training an agent manually via evaluative reinforcement. Proceedings of the 2008 7th IEEE International Conference on Development and Learning, Monterey, CA, USA.
3. Celemin, C., and Ruiz-del-Solar, J. (2015, January 27–31). COACH: Learning continuous actions from corrective advice communicated by humans. Proceedings of the 2015 International Conference on Advanced Robotics, Turkey, Istanbul.10.1109/ICAR.2015.7251514 ↗
4. Greenwald, A., Hall, K., and Serrano, R. (2003, January 21–24). Correlated Q-learning. Proceedings of the International Conference on Machine Learning, Wachington, DC, USA.
6. Kumar Shastha, T., Kyrarini, M., and Gräser, A. (2020). Application of Reinforcement Learning to a Robotic Drinking Assistant. Robotics, 9.10.3390/robotics9010001 ↗
7. Gait balance and acceleration of a biped robot based on Q-learning10.1109/ACCESS.2016.2570255 ↗
8. An integrated framework for human–robot collaborative manipulation10.1109/TCYB.2014.2363664 ↗
9. Reinforcement Learning in Robotics: Applications and Real-World Challenges10.3390/robotics2030122 ↗
10. Facilitating Human–Robot Collaborative Tasks by Teaching-Learning-Collaboration from Human Demonstrations10.1109/TASE.2018.2840345 ↗
11. Robot Learning from Demonstration in Robotic Assembly: A Survey10.3390/robotics7020017 ↗
12. Muñoz, G., Barrado, C., Çetin, E., and Salami, E. (2019). Deep Reinforcement Learning for Drone Delivery. Drones, 3.10.3390/drones3030072 ↗
13. Lee, S., and Choi, D.-H. (2019). Reinforcement Learning-Based Energy Management of Smart Home with Rooftop Solar Photovoltaic System, Energy Storage System, and Home Appliances. Sensors, 19.10.3390/s19183937 ↗
14. Hu, B., Li, J., Yang, J., Bai, H., Li, S., Sun, Y., and Yang, X. (2019). Reinforcement Learning Approach to Design Practical Adaptive Control for a Small-Scale Intelligent Vehicle. Symmetry, 11.10.3390/sym11091139 ↗
15. Zhang, P., Xiong, L., Yu, Z., Fang, P., Yan, S., Yao, J., and Zhou, Y. (2019). Reinforcement Learning-Based End-to-End Parking for Automatic Parking System. Sensors, 19.10.3390/s19183996 ↗
16. Ma, J., Hasegawa, S., Kim, S.-J., and Hasegawa, M. (2019). A Reinforcement-Learning-Based Distributed Resource Selection Algorithm for Massive IoT. Appl. Sci., 9.10.3390/app9183730 ↗
17. Lee, T., Jo, O., and Shin, K. (2020). CoRL: Collaborative Reinforcement Learning-Based MAC Protocol for IoT Networks. Electronics, 9.10.3390/electronics9010143 ↗
18. iRAF: A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing IoT Networks10.1109/JIOT.2019.2913162 ↗
19. Online deep reinforcement learning for computation offloading in blockchain-empowered mobile edge computing10.1109/TVT.2019.2924015 ↗
20. Multi-agent Reinforcement Learning based Evacuation Framework Considering Both Evacuation Time and Crowdedness
21. Human crowd evacuation framework and analysis using look-ahead-based reinforcement learning algorithm10.1504/IJDH.2016.079893 ↗
22. Pattern Recognition and Classifier Design of Bio-signals based Interface in Human-Artificial Intelligence Interaction (HAII) Framework for Real Time Evaluation of Emotions
23. Shin, S.-Y., Kang, Y.-W., and Kim, Y.-G. (2019). Obstacle Avoidance Drone by Deep Reinforcement Learning and Its Racing with Human Pilot. Appl. Sci., 9.10.3390/app9245571 ↗
24. Fang, X., Wang, J., Song, G., Han, Y., Zhao, Q., and Cao, Z. (2020). Multi-Agent Reinforcement Learning Approach for Residential Microgrid Energy Scheduling. Energies, 13.10.3390/en13010123 ↗
25. Guo, S., Zhang, X., Zheng, Y., and Du, Y. (2020). An Autonomous Path Planning Model for Unmanned Ships Based on Deep Reinforcement Learning. Sensors, 20.10.3390/s20020426 ↗
26. Wu, Q., Wang, H., Li, X., Zhang, B., and Peng, J. (2019). Reinforcement Learning-Based Anti-Jamming in Networked UAV Radar Systems. Appl. Sci., 9.10.3390/app9235173 ↗
27. Li, Y., Fu, K., Sun, H., and Sun, X. (2018). An Aircraft Detection Framework Based on Reinforcement Learning and Convolutional Neural Networks in Remote Sensing Images. Remote Sens., 10.10.3390/rs10020243 ↗