journal article·2020-07Open access

Machine Learning Glove Using Self‐Powered Conductive Superhydrophobic Triboelectric Textile for Gesture Recognition in VR/AR Applications

Feng Wen, Zhongda Sun, Tianyiyi He, Qiongfeng Shi, Minglu Zhu, Zixuan Zhang, Lianhui Li, Ting Zhang, Chengkuo Lee

Advanced Science· Volume 7· Issue 14

Abstract

Abstract The rapid progress of Internet of things (IoT) technology raises an imperative demand on human machine interfaces (HMIs) which provide a critical linkage between human and machines. Using a glove as an intuitive and low‐cost HMI can expediently track the motions of human fingers, resulting in a straightforward communication media of human–machine interactions. When combining several triboelectric textile sensors and proper machine learning technique, it has great potential to realize complex gesture recognition with the minimalist‐designed glove for the comprehensive control in both real and virtual space. However, humidity or sweat may negatively affect the triboelectric output as well as the textile itself. Hence, in this work, a facile carbon nanotubes/thermoplastic elastomer (CNTs/TPE) coating approach is investigated in detail to achieve superhydrophobicity of the triboelectric textile for performance improvement. With great energy harvesting and human motion sensing capabilities, the glove using the superhydrophobic textile realizes a low‐cost and self‐powered interface for gesture recognition. By leveraging machine learning technology, various gesture recognition tasks are done in real time by using gestures to achieve highly accurate virtual reality/augmented reality (VR/AR) controls including gun shooting, baseball pitching, and flower arrangement, with minimized effect from sweat during operation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Tactile and Sensory Interactions · Conducting polymers and applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical & Computer Engineering National University of Singapore 4 Engineering Drive 3 Singapore 117576 Singapore

National University of Singapore Suzhou Research Institute (NUSRI) Suzhou Industrial Park Suzhou 215123 China

Center for Intelligent Sensors and MEMS National University of Singapore 5 Engineering Drive 1 Singapore 117608 Singapore

Hybrid Integrated Flexible Electronic Systems (HIFES) 5 Engineering Drive 1 Singapore 117608 Singapore

i‐Lab Suzhou Institute of Nano‐Tech and Nano‐Bionics Chinese Academy of Sciences (CAS) Suzhou 215123 China

Funding

National University of Singapore

References (100+)

Show source-provided references
1. 10.1021/acsnano.8b0756710.1021/acsnano.8b07567 ↗
2. 10.1002/adfm.20160261910.1002/adfm.201602619 ↗
3. 10.1002/adma.20180071610.1002/adma.201800716 ↗
4. 10.1021/acsnano.9b0787410.1021/acsnano.9b07874 ↗
5. 10.1002/adfm.20180756010.1002/adfm.201807560 ↗
6. 10.1016/j.nanoen.2018.10.04910.1016/j.nanoen.2018.10.049 ↗
7. 10.1002/adma.20180107210.1002/adma.201801072 ↗
8. 10.1021/acsnano.7b0039610.1021/acsnano.7b00396 ↗
9. 10.1021/acsnano.6b0738910.1021/acsnano.6b07389 ↗
10. 10.1021/acsnano.8b0014710.1021/acsnano.8b00147 ↗
11. 10.1002/smll.20180287610.1002/smll.201802876 ↗
12. 10.1002/adma.20170198510.1002/adma.201701985 ↗
13. 10.1002/adfm.20180795710.1002/adfm.201807957 ↗
14. 10.1038/nature2549410.1038/nature25494 ↗
15. 10.1002/adhm.20160009210.1002/adhm.201600092 ↗
16. 10.1038/s41467-017-01210-210.1038/s41467-017-01210-2 ↗
17. 10.1126/sciadv.aax064910.1126/sciadv.aax0649 ↗
18. 10.1002/adfm.20160123710.1002/adfm.201601237 ↗
19. 10.1016/j.nanoen.2019.10414310.1016/j.nanoen.2019.104143 ↗
20. 10.1038/s41928-019-0257-710.1038/s41928-019-0257-7 ↗
21. 10.1002/smll.20190155810.1002/smll.201901558 ↗
22. 10.1002/adfm.20180878610.1002/adfm.201808786 ↗
23. 10.1002/adma.20150424910.1002/adma.201504249 ↗
24. 10.1016/j.nanoen.2019.03.07110.1016/j.nanoen.2019.03.071 ↗
25. 10.1016/j.nanoen.2018.09.02410.1016/j.nanoen.2018.09.024 ↗
26. 10.1002/adma.20140136410.1002/adma.201401364 ↗
27. 10.1002/adfm.20140298710.1002/adfm.201402987 ↗
28. 10.1002/advs.20190061710.1002/advs.201900617 ↗
29. 10.1126/sciadv.aav965310.1126/sciadv.aav9653 ↗
30. 10.1002/aisy.20190009010.1002/aisy.201900090 ↗
31. 10.1002/admt.20160013610.1002/admt.201600136 ↗
32. 10.1016/j.nanoen.2019.01.09110.1016/j.nanoen.2019.01.091 ↗
33. 10.1038/nenergy.2016.13810.1038/nenergy.2016.138 ↗
34. 10.1016/j.nanoen.2018.10.03610.1016/j.nanoen.2018.10.036 ↗
35. 10.1038/s41467-018-06759-010.1038/s41467-018-06759-0 ↗
36. 10.1021/acsnano.7b0753410.1021/acsnano.7b07534 ↗
37. 10.1126/scirobotics.aau691410.1126/scirobotics.aau6914 ↗
38. 10.1038/s41586-019-1234-z10.1038/s41586-019-1234-z ↗
39. 10.1002/adfm.20190580810.1002/adfm.201905808 ↗
40. 10.1021/acssensors.6b0014510.1021/acssensors.6b00145 ↗
41. 10.1016/j.nanoen.2019.01.09610.1016/j.nanoen.2019.01.096 ↗
42. 10.1016/j.nanoen.2018.11.07510.1016/j.nanoen.2018.11.075 ↗
43. 10.1109/TNANO.2017.278930010.1109/TNANO.2017.2789300 ↗
44. 10.1109/TNANO.2016.252218710.1109/TNANO.2016.2522187 ↗
45. 10.1109/TNANO.2017.265938310.1109/TNANO.2017.2659383 ↗
46. 10.1016/j.nanoen.2019.06.04010.1016/j.nanoen.2019.06.040 ↗
47. 10.1016/j.nanoen.2017.08.01810.1016/j.nanoen.2017.08.018 ↗
48. 10.1016/j.nanoen.2016.10.04610.1016/j.nanoen.2016.10.046 ↗
49. 10.1016/j.nanoen.2016.02.05410.1016/j.nanoen.2016.02.054 ↗
50. 10.1016/j.nanoen.2019.10387110.1016/j.nanoen.2019.103871 ↗
51. 10.1016/j.nanoen.2019.05.03310.1016/j.nanoen.2019.05.033 ↗
52. 10.1016/j.nanoen.2019.03.09010.1016/j.nanoen.2019.03.090 ↗
53. 10.1016/j.nanoen.2018.03.02710.1016/j.nanoen.2018.03.027 ↗
54. 10.1016/j.nanoen.2012.01.00410.1016/j.nanoen.2012.01.004 ↗
55. 10.1126/scirobotics.aat251610.1126/scirobotics.aat2516 ↗
56. 10.1021/acsnano.6b0392610.1021/acsnano.6b03926 ↗
57. 10.1002/aenm.20170308610.1002/aenm.201703086 ↗
58. 10.1016/j.nanoen.2019.10416710.1016/j.nanoen.2019.104167 ↗
59. 10.1038/s41467-019-09464-810.1038/s41467-019-09464-8 ↗
60. 10.1021/acsnano.8b0041610.1021/acsnano.8b00416 ↗
61. 10.1002/advs.20190014910.1002/advs.201900149 ↗
62. 10.1021/acsnano.9b0014010.1021/acsnano.9b00140 ↗
63. 10.1002/adfm.20180368410.1002/adfm.201803684 ↗
64. 10.1002/aenm.20160239710.1002/aenm.201602397 ↗
65. 10.1021/acsnano.9b0491110.1021/acsnano.9b04911 ↗
66. 10.1038/s41467-019-09461-x10.1038/s41467-019-09461-x ↗
67. 10.1016/j.nanoen.2019.10403910.1016/j.nanoen.2019.104039 ↗
68. 10.1016/j.nanoen.2019.03.08210.1016/j.nanoen.2019.03.082 ↗
69. 10.1016/j.nanoen.2018.04.00410.1016/j.nanoen.2018.04.004 ↗
70. 10.1021/acsnano.8b0030310.1021/acsnano.8b00303 ↗
71. 10.1002/advs.20170014310.1002/advs.201700143 ↗
72. 10.1002/advs.20150044110.1002/advs.201500441 ↗
73. 10.1021/acsnano.7b0521310.1021/acsnano.7b05213 ↗
74. 10.1002/advs.20190143710.1002/advs.201901437 ↗
75. 10.1016/j.nanoen.2019.05.02910.1016/j.nanoen.2019.05.029 ↗
76. 10.1016/j.nanoen.2019.10398410.1016/j.nanoen.2019.103984 ↗
77. 10.1016/j.nanoen.2018.06.02210.1016/j.nanoen.2018.06.022 ↗
78. 10.1016/j.nanoen.2015.04.02010.1016/j.nanoen.2015.04.020 ↗
79. 10.1021/acsnano.8b0674710.1021/acsnano.8b06747 ↗
80. 10.1016/j.nanoen.2018.10.04410.1016/j.nanoen.2018.10.044 ↗
81. 10.1007/s40820-019-0271-310.1007/s40820-019-0271-3 ↗
82. 10.1002/admt.20180048710.1002/admt.201800487 ↗
83. 10.1016/j.nanoen.2018.09.03010.1016/j.nanoen.2018.09.030 ↗
84. 10.1016/j.nanoen.2018.11.07810.1016/j.nanoen.2018.11.078 ↗
85. 10.1016/j.mattod.2018.01.00610.1016/j.mattod.2018.01.006 ↗
86. 10.1002/admt.20180016710.1002/admt.201800167 ↗
87. 10.1021/nn506832w10.1021/nn506832w ↗
88. 10.1002/aisy.20190008810.1002/aisy.201900088 ↗
89. 10.1002/aenm.20180215910.1002/aenm.201802159 ↗
90. 10.1021/acsami.9b0456910.1021/acsami.9b04569 ↗
91. 10.1002/admt.20170023710.1002/admt.201700237 ↗
92. 10.3390/nano907094510.3390/nano9070945 ↗
93. 10.1002/adfm.20160446210.1002/adfm.201604462 ↗
94. 10.1016/j.nanoen.2019.04.00410.1016/j.nanoen.2019.04.004 ↗
95. 10.1016/j.nanoen.2018.06.02910.1016/j.nanoen.2018.06.029 ↗
96. 10.1016/j.nanoen.2019.01.06910.1016/j.nanoen.2019.01.069 ↗
97. 10.1002/adma.20140118410.1002/adma.201401184 ↗
98. 10.1021/am200033u10.1021/am200033u ↗
99. 10.1002/aenm.20170124310.1002/aenm.201701243 ↗
100. 10.1039/C7TA01302G10.1039/C7TA01302G ↗