journal article·2024-04-09

Multimodal Sensors Enabled Autonomous Soft Robotic System with Self-Adaptive Manipulation

Tianhong Wang, Tao Jin, Weiyang Lin, Yangqiao Lin, Hongfei Liu, Tao Yue, Yingzhong Tian, Long Li, Quan Zhang, Chengkuo Lee

ACS Nano· Volume 18· Issue 14
Publisher page

Abstract

Human hands are amazingly skilled at recognizing and handling objects of different sizes and shapes. To date, soft robots rarely demonstrate autonomy equivalent to that of humans for fine perception and dexterous operation. Here, an intelligent soft robotic system with autonomous operation and multimodal perception ability is developed by integrating capacitive sensors with triboelectric sensor. With distributed multiple sensors, our robot system can not only sense and memorize multimodal information but also enable an adaptive grasping method for robotic positioning and grasp control, during which the multimodal sensory information can be captured sensitively and fused at feature level for crossmodally recognizing objects, leading to a highly enhanced recognition capability. The proposed system, combining the performance and physical intelligence of biological systems (i.e., self-adaptive behavior and multimodal perception), will greatly advance the integration of soft actuators and robotics in many fields.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Soft Robotics and Applications · Modular Robots and Swarm Intelligence

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Shanghai Key Laboratory of Intelligent Manufacturing and Robotics, Shanghai University, Shanghai 200444, People’s Republic of China

School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, People’s Republic of China

School of Artificial Intelligence, Shanghai University, Shanghai 200444, People’s Republic of China

Advanced Robotics Centre, National University of Singapore, Singapore 117608, Singapore

Research Institute of Intelligent Control and Systems, Harbin Institute of Technology, Harbin 150001, People’s Republic of China

Department of Mechanical and Mechatronics Engineering, The University of Auckland, Auckland 1010, New Zealand

Department of Electrical & Computer Engineering, National University of Singapore, 4 Engineering Drive 3, Singapore 117583, Singapore

Center for Intelligent Sensors and MEMS, National University of Singapore, 4 Engineering Drive 3, Singapore 117583, Singapore

Funding

Natural Science Foundation of Shanghai Municipality · China Scholarship Council · National Natural Science Foundation of China · Shanghai Rising-Star Program · Shanghai Sailing Program

References (79)

Show source-provided references
1. 10.1126/scirobotics.aar765010.1126/scirobotics.aar7650 ↗
2. 10.1002/adfm.20220908010.1002/adfm.202209080 ↗
3. 10.1038/s41563-021-01158-110.1038/s41563-021-01158-1 ↗
4. 10.1038/nature1454310.1038/nature14543 ↗
5. 10.1089/soro.2018.001910.1089/soro.2018.0019 ↗
6. 10.1038/s41467-020-19059-310.1038/s41467-020-19059-3 ↗
7. 10.1126/scirobotics.aah369010.1126/scirobotics.aah3690 ↗
8. 10.1038/s42256-023-00728-z10.1038/s42256-023-00728-z ↗
9. 10.1038/s41578-021-00389-710.1038/s41578-021-00389-7 ↗
10. 10.1002/adma.20200308810.1002/adma.202003088 ↗
11. 10.1089/soro.2022.006410.1089/soro.2022.0064 ↗
12. 10.1002/adfm.20190920210.1002/adfm.201909202 ↗
13. 10.1002/advs.20210434710.1002/advs.202104347 ↗
14. 10.1002/aisy.20220030410.1002/aisy.202200304 ↗
15. 10.1002/adma.20170703510.1002/adma.201707035 ↗
16. 10.1109/LRA.2019.289587710.1109/LRA.2019.2895877 ↗
17. 10.1089/soro.2021.002510.1089/soro.2021.0025 ↗
18. 10.1038/s41928-018-0024-110.1038/s41928-018-0024-1 ↗
19. 10.1177/027836492091720310.1177/0278364920917203 ↗
20. 10.1109/TIE.2019.295825410.1109/TIE.2019.2958254 ↗
21. 10.1038/s41551-021-00767-010.1038/s41551-021-00767-0 ↗
22. 10.1109/TRO.2022.317249810.1109/TRO.2022.3172498 ↗
23. 10.1126/scirobotics.abn049510.1126/scirobotics.abn0495 ↗
24. 10.1038/s41598-022-16087-510.1038/s41598-022-16087-5 ↗
25. 10.1002/adfm.20130304710.1002/adfm.201303047 ↗
26. 10.1126/sciadv.aaz869310.1126/sciadv.aaz8693 ↗
27. 10.1002/adma.20170638310.1002/adma.201706383 ↗
28. 10.1038/s42254-022-00481-z10.1038/s42254-022-00481-z ↗
29. 10.1038/s41467-022-32702-510.1038/s41467-022-32702-5 ↗
30. 10.1126/scirobotics.aai752910.1126/scirobotics.aai7529 ↗
31. 10.1002/aisy.20220032910.1002/aisy.202200329 ↗
32. 10.1126/scirobotics.aav148810.1126/scirobotics.aav1488 ↗
33. 10.1109/TMECH.2017.269967710.1109/TMECH.2017.2699677 ↗
34. 10.1089/soro.2020.014710.1089/soro.2020.0147 ↗
35. 10.1109/LRA.2020.297285110.1109/LRA.2020.2972851 ↗
36. 10.1109/TRO.2016.263689910.1109/TRO.2016.2636899 ↗
37. 10.1126/scirobotics.abd642610.1126/scirobotics.abd6426 ↗
38. 10.1002/advs.20180054110.1002/advs.201800541 ↗
39. 10.1109/TRO.2021.309664410.1109/TRO.2021.3096644 ↗
40. 10.1109/JSEN.2020.299960010.1109/JSEN.2020.2999600 ↗
41. 10.1016/j.sna.2021.11308410.1016/j.sna.2021.113084 ↗
42. 10.1016/j.sna.2021.11312110.1016/j.sna.2021.113121 ↗
43. 10.1016/j.nanoen.2021.10650110.1016/j.nanoen.2021.106501 ↗
44. 10.1021/acsnano.1c0279010.1021/acsnano.1c02790 ↗
45. 10.1002/eom2.1205810.1002/eom2.12058 ↗
46. 10.1002/advs.20210086410.1002/advs.202100864 ↗
47. 10.1038/s41467-022-32745-810.1038/s41467-022-32745-8 ↗
48. 10.1016/j.isci.2023.10724910.1016/j.isci.2023.107249 ↗
49. 10.1021/acsnano.2c0404310.1021/acsnano.2c04043 ↗
50. 10.1038/s41928-023-01093-w10.1038/s41928-023-01093-w ↗
51. 10.1016/j.nanoen.2019.10441710.1016/j.nanoen.2019.104417 ↗
52. 10.1016/j.apmt.2018.09.00510.1016/j.apmt.2018.09.005 ↗
53. 10.1002/advs.20210369410.1002/advs.202103694 ↗
54. 10.1002/advs.20230394910.1002/advs.202303949 ↗
55. 10.1016/j.nanoen.2023.10890310.1016/j.nanoen.2023.108903 ↗
56. 10.1038/s43016-023-00817-710.1038/s43016-023-00817-7 ↗
57. 10.1126/sciadv.adg515210.1126/sciadv.adg5152 ↗
58. 10.1002/adma.20230059310.1002/adma.202300593 ↗
59. 10.1016/j.nanoen.2022.10808410.1016/j.nanoen.2022.108084 ↗
60. 10.1016/j.nanoen.2023.10872910.1016/j.nanoen.2023.108729 ↗
61. 10.1002/adfm.20200444610.1002/adfm.202004446 ↗
62. 10.1021/acsnano.2c1259210.1021/acsnano.2c12592 ↗
63. 10.1126/sciadv.abb908310.1126/sciadv.abb9083 ↗
64. 10.1002/adma.20210206910.1002/adma.202102069 ↗
65. 10.1016/j.sbsr.2021.10043410.1016/j.sbsr.2021.100434 ↗
66. 10.1557/s43577-021-00079-310.1557/s43577-021-00079-3 ↗
67. 10.1038/s41467-020-18375-y10.1038/s41467-020-18375-y ↗
68. 10.1126/science.ade008610.1126/science.ade0086 ↗
69. 10.1038/nrn262110.1038/nrn2621 ↗
70. 10.1126/scirobotics.aax219810.1126/scirobotics.aax2198 ↗
71. 10.1126/scirobotics.abc813410.1126/scirobotics.abc8134 ↗
72. 10.1126/scirobotics.aat251610.1126/scirobotics.aat2516 ↗
73. 10.1038/s41467-021-25637-w10.1038/s41467-021-25637-w ↗
74. 10.1021/acsnano.2c1245810.1021/acsnano.2c12458 ↗
75. 10.1002/advs.20210023010.1002/advs.202100230 ↗
76. 10.1016/j.neuron.2013.07.05110.1016/j.neuron.2013.07.051 ↗
77. 10.1038/nmat467110.1038/nmat4671 ↗
78. 10.1039/c3ee42571a10.1039/c3ee42571a ↗
79. 10.1109/MPUL.2010.93917610.1109/MPUL.2010.939176 ↗