journal article·2022-01-17Open access

Smart Industrial Robot Control Trends, Challenges and Opportunities within Manufacturing

Janis Arents, Modris Greitans

Applied Sciences· Volume 12· Issue 2

Abstract

Industrial robots and associated control methods are continuously developing. With the recent progress in the field of artificial intelligence, new perspectives in industrial robot control strategies have emerged, and prospects towards cognitive robots have arisen. AI-based robotic systems are strongly becoming one of the main areas of focus, as flexibility and deep understanding of complex manufacturing processes are becoming the key advantage to raise competitiveness. This review first expresses the significance of smart industrial robot control in manufacturing towards future factories by listing the needs, requirements and introducing the envisioned concept of smart industrial robots. Secondly, the current trends that are based on different learning strategies and methods are explored. Current computer-vision, deep reinforcement learning and imitation learning based robot control approaches and possible applications in manufacturing are investigated. Gaps, challenges, limitations and open issues are identified along the way.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robot Manipulation and Learning · Industrial Vision Systems and Defect Detection · Digital Transformation in Industry

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Electronics and Computer Science, 14 Dzerbenes St., LV-1006 Riga, Latvia

Funding

The work has been performed in the project AI4DI: Artificial Intelligence for Digitizing Industry, under grant agreement No 826060. The project is co-funded by grants from Germany, Austria, Finland, France, Norway, Latvia, Belgium, Italy, Switzerland, and

References (100+)

Show source-provided references
1. Wallén, J. (2008). The History of the Industrial Robot, Linköping University Electronic Press.
2. International Organization for Standardization (ISO) (2012). ISO 8373:2012: Robots and Robotic Devices—Vocabulary, International Organization for Standardization.
3. Wilson, M. (2015). Chapter 2—Industrial Robots. Implementation of Robot Systems, Butterworth-Heinemann.10.1016/B978-0-12-404733-4.00002-3 ↗
4. Carlsson, J. (1991). A Decade of Robotics: [Analysis of the Diffusion of Industrial Robots in the 1980s by Countries, Application Areas, Industrial Branches and Types of Robots], Mekanförbundets Förlag.
5. Intelligent Manufacturing in the Context of Industry 4.0: A Review10.1016/J.ENG.2017.05.015 ↗
6. (2021, November 20). Executive Summary World Robotics 2021 Industrial Robots. Available online: https://ifr.org/img/worldrobotics/Executive_Summary_WR_Industrial_Robots_2021.pdf.
7. Sanneman, L., Fourie, C., and Shah, J.A. (2020). The state of industrial robotics: Emerging technologies, challenges, and key research directions. arXiv.10.1561/9781680838015 ↗
8. Recent progress on programming methods for industrial robots10.1016/j.rcim.2011.08.004 ↗
9. Trends in Smart Manufacturing: Role of Humans and Industrial Robots in Smart Factories10.1007/s43154-020-00006-5 ↗
10. Probst, L., Pedersen, B., Lefebvre, V., and Dakkak, L. (2018). USA-China-EU plans for AI: Where do we stand. Digit. Transform. Monit. Eur. Comm., Available online: https://ati.ec.europa.eu/reports/technology-watch/usa-china-eu-plans-ai-where-do-we-stand-0.
11. Arents, J., Abolins, V., Judvaitis, J., Vismanis, O., Oraby, A., and Ozols, K. (2021). Human–Robot Collaboration Trends and Safety Aspects: A Systematic Review. J. Sens. Actuator Netws., 10.10.3390/jsan10030048 ↗
12. The smart factory as a key construct of industry 4.0: A systematic literature review10.1016/j.ijpe.2019.08.011 ↗
13. Maddikunta, P.K.R., Pham, Q.V., Prabadevi, B., Deepa, N., Dev, K., Gadekallu, T.R., Ruby, R., and Liyanage, M. (2021). Industry 5.0: A survey on enabling technologies and potential applications. J. Ind. Inf. Integr.10.1016/j.jii.2021.100257 ↗
14. Intelligent Industrial Robots
15. Shao, L., and Volz, R. (1989, January 31). Methods and strategies of object localization. Proceedings of the NASA Conference on Space Telerobotics, Pasadena, CA, USA.
16. Study on artificial intelligence: The state of the art and future prospects
17. Common Sensors in Industrial Robots: A Review10.1088/1742-6596/1267/1/012036 ↗
18. Smart manufacturing: Characteristics, technologies and enabling factors10.1177/0954405417736547 ↗
19. Abubakr, M., Abbas, A.T., Tomaz, I., Soliman, M.S., Luqman, M., and Hegab, H. (2020). Sustainable and Smart Manufacturing: An Integrated Approach. Sustainability, 12.10.3390/su12062280 ↗
20. Integration of Computervision and Artificial Intelligence Subsystems with Robot Operating System Based Motion Planning for Industrial Robots10.3103/S0146411618050024 ↗
21. Wei, K., and Ren, B. (2018). A method on dynamic path planning for robotic manipulator autonomous obstacle avoidance based on an improved RRT algorithm. Sensors, 18.10.3390/s18020571 ↗
22. Vernon, D., and Vincze, M. (2016, January 8–9). Industrial Priorities for Cognitive Robotics. Proceedings of the EUCognition 2016—“Cognitive Robot Architectures”, Vienna, Austria.
23. Kraetzschmar, G. (2021, June 03). Software Engineering Factors for Cognitive Robotics. Available online: https://cordis.europa.eu/project/id/688441/results.
24. Samani, H. (2015). Cognitive Robotics, CRC Press.10.1201/b19171 ↗
25. Siegwart, R., Nourbakhsh, I.R., and Scaramuzza, D. (2011). Introduction to Autonomous Mobile Robots, MIT Press.
26. Premebida, C., Ambrus, R., and Marton, Z.C. (2018). Intelligent robotic perception systems. Applications of Mobile Robots, IntechOpen.10.5772/intechopen.79742 ↗
27. A survey on deep learning and its applications10.1016/j.cosrev.2021.100379 ↗
28. Alom, M.Z., Taha, T.M., Yakopcic, C., Westberg, S., Sidike, P., Nasrin, M.S., Hasan, M., Van Essen, B.C., Awwal, A.A.S., and Asari, V.K. (2019). A State-of-the-Art Survey on Deep Learning Theory and Architectures. Electronics, 8.10.3390/electronics8030292 ↗
29. A critical review on computer vision and artificial intelligence in food industry
30. Deep Learning for Detecting Robotic Grasps10.1177/0278364914549607 ↗
31. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, faster, stronger. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
32. Faster R-CNN: Towards real-time object detection with region proposal networks
33. Zou, Z., Shi, Z., Guo, Y., and Ye, J. (2019). Object detection in 20 years: A survey. arXiv.
34. Poss, C., Mlouka, O.B., Irrenhauser, T., Prueglmeier, M., Goehring, D., Zoghlami, F., and Salehi, V. (2019, January 14–17). Robust Framework for intelligent Gripping Point Detection. Proceedings of the IECON 2019—45th Annual Conference of the IEEE Industrial Electronics Society, Lisbon, Portugal.10.1109/IECON.2019.8927308 ↗
35. Recognition and Pose Estimation of Auto Parts for an Autonomous Spray Painting Robot10.1109/TII.2018.2882446 ↗
36. Arents, J., Greitans, M., and Lesser, B. (2021). Construction of a Smart Vision-Guided Robot System for Manipulation in a Dynamic Environment. Artificial Intelligence for Digitising Industry, River Publishers.10.1201/9781003337232-18 ↗
37. Mahler, J., Matl, M., Liu, X., Li, A., Gealy, D., and Goldberg, K. (2018). Dex-Net 3.0: Computing Robust Robot Vacuum Suction Grasp Targets in Point Clouds using a New Analytic Model and Deep Learning. arXiv.10.1109/ICRA.2018.8460887 ↗
38. Learning ambidextrous robot grasping policies10.1126/scirobotics.aau4984 ↗
39. Robotic arc welding sensors and programming in industrial applications10.1186/s40712-015-0042-y ↗
40. Wu, Q., Lu, J., Zou, W., and Xu, D. (2015, January 2–5). Path planning for surface inspection on a robot-based scanning system. Proceedings of the 2015 IEEE International Conference on Mechatronics and Automation (ICMA), Beijing, China.10.1109/ICMA.2015.7237842 ↗
41. Skotheim, O., Lind, M., Ystgaard, P., and Fjerdingen, S.A. (2012, January 7–12). A flexible 3D object localization system for industrial part handling. Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vilamoura-Algarve, Portugal.10.1109/IROS.2012.6385508 ↗
42. Robotic Path Planning for an Automatic Mold Polishing System
43. Zhen, X., Seng, J.C.Y., and Somani, N. (2019, January 10–13). Adaptive Automatic Robot Tool Path Generation Based on Point Cloud Projection Algorithm. Proceedings of the 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Zaragoza, Spain.10.1109/ETFA.2019.8869301 ↗
44. Peng, R., Navarro-Alarcon, D., Wu, V., and Yang, W. (2020, January 22–26). A Point Cloud-Based Method for Automatic Groove Detection and Trajectory Generation of Robotic Arc Welding Tasks. Proceedings of the 2020 17th International Conference on Ubiquitous Robots (UR), Kyoto, Japan.10.1109/UR49135.2020.9144861 ↗
45. What are the important technologies for bin picking? Technology analysis of robots in competitions based on a set of performance metrics
46. The Mechanical Manipulation of Randomly Oriented Parts10.1038/scientificamerican0884-100 ↗
47. Marvel, J.A., Saidi, K., Eastman, R., Hong, T., Cheok, G., and Messina, E. (2012). Technology readiness levels for randomized bin picking, Proceedings of the Workshop on Performance Metrics for Intelligent Systems (PerMI′12) Workshop, Special Publication (NIST SP).10.1145/2393091.2393114 ↗
48. Holz, D., Topalidou-Kyniazopoulou, A., Stückler, J., and Behnke, S. (October, January 28). Real-time object detection, localization and verification for fast robotic depalletizing. Proceedings of the 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.10.1109/IROS.2015.7353560 ↗
49. A Survey on Learning-Based Robotic Grasping10.1007/s43154-020-00021-6 ↗
50. Gripping Point Determination for Bin Picking Using Heuristic Search10.1016/j.procir.2016.06.015 ↗
51. He, R., Rojas, J., and Guan, Y. (2017). A 3D Object Detection and Pose Estimation Pipeline Using RGB-D Images. arXiv.10.1109/ROBIO.2017.8324634 ↗
52. Sock, J., Kim, K., Sahin, C., and Kim, T.K. (2019). Multi-task deep networks for depth-based 6D object pose and joint registration in crowd scenarios. arXiv.
53. Kehl, W., Manhardt, F., Tombari, F., Ilic, S., and Navab, N. (2017). SSD-6D: Making RGB-based 3D detection and 6D pose estimation great again. arXiv.10.1109/ICCV.2017.169 ↗
54. A collaborative robot cell for random bin-picking based on deep learning policies and a multi-gripper switching strategy10.1016/j.promfg.2020.10.002 ↗
55. Rad, M., and Lepetit, V. (2018). BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depth. arXiv.10.1109/ICCV.2017.413 ↗
56. Xiang, Y., Schmidt, T., Narayanan, V., and Fox, D. (2018). PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes. arXiv.10.15607/RSS.2018.XIV.019 ↗
57. Tremblay, J., To, T., Sundaralingam, B., Xiang, Y., Fox, D., and Birchfield, S. (2018). Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objects. arXiv.
58. EPnP: An accurate O(n) solution to the PnP problem10.1007/s11263-008-0152-6 ↗
59. Morrison, D., Corke, P., and Leitner, J. (2018). Closing the Loop for Robotic Grasping: A Real-time, Generative Grasp Synthesis Approach. arXiv.10.15607/RSS.2018.XIV.021 ↗
60. Design of a Deep Post Gripping Perception Framework for Industrial Robots10.1115/1.4048204 ↗
61. Matsumura, R., Domae, Y., Wan, W., and Harada, K. (2019, January 3–8). Learning Based Robotic Bin-picking for Potentially Tangled Objects. Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.10.1109/IROS40897.2019.8968295 ↗
62. Increasing the Robustness of Random Bin Picking by Avoiding Grasps of Entangled Workpieces10.1016/j.procir.2020.03.082 ↗
63. Mastering the game of Go with deep neural networks and tree search10.1038/nature16961 ↗
64. Reinforcement learning in robotics: A survey10.1177/0278364913495721 ↗
65. Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press.
66. Liu, R., Nageotte, F., Zanne, P., de Mathelin, M., and Dresp-Langley, B. (2021). Deep Reinforcement Learning for the Control of Robotic Manipulation: A Focussed Mini-Review. Robotics, 10.10.3390/robotics10010022 ↗
67. A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithms
68. Chebotar, Y., Hausman, K., Zhang, M., Sukhatme, G., Schaal, S., and Levine, S. (2017, January 6–11). Combining model-based and model-free updates for trajectory-centric reinforcement learning. Proceedings of the International Conference on Machine Learning, Sydney, Australia.
69. Deep Reinforcement Learning: A Brief Survey10.1109/MSP.2017.2743240 ↗
70. Hua, J., Zeng, L., Li, G., and Ju, Z. (2021). Learning for a robot: Deep reinforcement learning, imitation learning, transfer learning. Sensors, 21.10.3390/s21041278 ↗
71. Zhan, A., Zhao, P., Pinto, L., Abbeel, P., and Laskin, M. (2020). A Framework for Efficient Robotic Manipulation. arXiv.
72. Quillen, D., Jang, E., Nachum, O., Finn, C., Ibarz, J., and Levine, S. (2018, January 21–25). Deep reinforcement learning for vision-based robotic grasping: A simulated comparative evaluation of off-policy methods. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.10.1109/ICRA.2018.8461039 ↗
73. Joshi, S., Kumra, S., and Sahin, F. (2020, January 20–21). Robotic Grasping using Deep Reinforcement Learning. Proceedings of the 2020 IEEE 16th International Conference on Automation Science and Engineering (CASE), Hong Kong, China.10.1109/CASE48305.2020.9216986 ↗
74. Wang, Y., Lan, X., Feng, C., Wan, L., Li, J., Liu, Y., and Li, D. (August, January 29). An experience-based policy gradient method for smooth manipulation. Proceedings of the 2019 IEEE 9th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), Suzhou, China.10.1109/CYBER46603.2019.9066580 ↗
75. Pedersen, O.M., Misimi, E., and Chaumette, F. (August, January 31). Grasping Unknown Objects by Coupling Deep Reinforcement Learning, Generative Adversarial Networks, and Visual Servoing. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.10.1109/ICRA40945.2020.9197196 ↗
76. Chen, Y., Ju, Z., and Yang, C. (2020, January 19–24). Combining reinforcement learning and rule-based method to manipulate objects in clutter. Proceedings of the 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, UK.10.1109/IJCNN48605.2020.9207153 ↗
77. Zeng, A., Song, S., Welker, S., Lee, J., Rodriguez, A., and Funkhouser, T. (2018, January 1–5). Learning Synergies Between Pushing and Grasping with Self-Supervised Deep Reinforcement Learning. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8593986 ↗
78. A deep learning approach to grasping the invisible10.1109/LRA.2020.2970622 ↗
79. Artificial Tactile Sensor Structure for Surface Topography Through Sliding10.1109/TMECH.2018.2870917 ↗
80. Improved learning of robot manipulation tasks via tactile intrinsic motivation10.1109/LRA.2021.3061308 ↗
81. Merzić, H., Bogdanović, M., Kappler, D., Righetti, L., and Bohg, J. (2019, January 20–24). Leveraging contact forces for learning to grasp. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.10.1109/ICRA.2019.8793733 ↗
82. Johannink, T., Bahl, S., Nair, A., Luo, J., Kumar, A., Loskyll, M., Ojea, J.A., Solowjow, E., and Levine, S. (2019, January 20–24). Residual reinforcement learning for robot control. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.10.1109/ICRA.2019.8794127 ↗
83. Learning force control for contact-rich manipulation tasks with rigid position-controlled robots10.1109/LRA.2020.3010739 ↗
84. Huang, S.H., Zambelli, M., Kay, J., Martins, M.F., Tassa, Y., Pilarski, P.M., and Hadsell, R. (2019). Learning gentle object manipulation with curiosity-driven deep reinforcement learning. arXiv.
85. Melnik, A., Lach, L., Plappert, M., Korthals, T., Haschke, R., and Ritter, H. (2019, January 8). Tactile sensing and deep reinforcement learning for in-hand manipulation tasks. Proceedings of the IROS Workshop on Autonomous Object Manipulation, Venetian Macao, Macau, China.
86. “Good Robot!”: Efficient Reinforcement Learning for Multi-Step Visual Tasks with Sim to Real Transfer10.1109/LRA.2020.3015448 ↗
87. Thomas, G., Chien, M., Tamar, A., Ojea, J.A., and Abbeel, P. (2018, January 21–25). Learning robotic assembly from cad. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.10.1109/ICRA.2018.8460696 ↗
88. Luo, J., Solowjow, E., Wen, C., Ojea, J.A., Agogino, A.M., Tamar, A., and Abbeel, P. (2019, January 20–24). Reinforcement Learning on Variable Impedance Controller for High-Precision Robotic Assembly. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.10.1109/ICRA.2019.8793506 ↗
89. Deep reinforcement learning based moving object grasping10.1016/j.ins.2021.01.077 ↗
90. Living Object Grasping Using Two-Stage Graph Reinforcement Learning10.1109/LRA.2021.3060636 ↗
91. Attia, A., and Dayan, S. (2018). Global overview of imitation learning. arXiv.
92. Osa, T., Pajarinen, J., Neumann, G., Bagnell, J.A., Abbeel, P., and Peters, J. (2018). An algorithmic perspective on imitation learning. arXiv.10.1561/9781680834116 ↗
93. Survey of imitation learning for robotic manipulation10.1007/s41315-019-00103-5 ↗
94. Imitation learning-based framework for learning 6-D linear compliant motions10.1007/s10514-021-09971-y ↗
95. Skill learning and action recognition by arc-length dynamic movement primitives10.1016/j.robot.2017.11.012 ↗
96. Combining imitation learning with constraint-based task specification and control10.1109/LRA.2019.2898035 ↗
97. Gubbi, S., Kolathaya, S., and Amrutur, B. (2020, January 20–23). Imitation Learning for High Precision Peg-in-Hole Tasks. Proceedings of the 2020 6th International Conference on Control, Automation and Robotics (ICCAR), Singapore.10.1109/ICCAR49639.2020.9108072 ↗
98. Zhang, T., McCarthy, Z., Jow, O., Lee, D., Chen, X., Goldberg, K., and Abbeel, P. (2018, January 21–25). Deep imitation learning for complex manipulation tasks from virtual reality teleoperation. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.10.1109/ICRA.2018.8461249 ↗
99. Sermanet, P., Lynch, C., Chebotar, Y., Hsu, J., Jang, E., Schaal, S., Levine, S., and Brain, G. (2018, January 21–25). Time-contrastive networks: Self-supervised learning from video. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.10.1109/ICRA.2018.8462891 ↗
100. Edmonds, M., Gao, F., Xie, X., Liu, H., Qi, S., Zhu, Y., Rothrock, B., and Zhu, S.C. (2017, January 24–28). Feeling the force: Integrating force and pose for fluent discovery through imitation learning to open medicine bottles. Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.10.1109/IROS.2017.8206196 ↗