journal article·2021-09Open access

Emerging Thermal Technology Enabled Augmented Reality

Kaushik Parida, Hyunwoo Bark, Pooi See Lee

Advanced Functional Materials· Volume 31· Issue 39

Abstract

Abstract In the past decade, remarkable progress has been made in the domain of augmented reality/virtual reality (AR/VR). The need for realistic and immersive augmentation has propelled the development of haptics interfaces‐enabled AR/VR. The haptics interfaces facilitate direct interaction and manipulation with both real and virtual objects, thus augmenting the perception and experiences of the users. The level of augmentation can be significantly improved by thermal stimulation or sensing, which facilitates a higher degree of object identification and discrimination. This review discusses the thermal technology‐enabled augmented reality and summarizes the recent progress in the development of different thermal technology such as thermal haptics including thermo‐resistive heater and Peltier devices, thermal sensors including resistive, pyroelectric, and thermoelectric sensors, which can be utilized to improve the realism of augmentation. The fundamental mechanism, design strategies, and the rational guidelines for the adoption of these technologies in AR/VR is explicitly discussed. The conclusion provides an outlook on the existing challenges and outlines the future roadmap for the realization of next‐generation thermo‐haptics enabled augmented reality.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Tactile and Sensory Interactions · Advanced Sensor and Energy Harvesting Materials · Transition Metal Oxide Nanomaterials

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Materials Science and Engineering Nanyang Technological University 50 Nanyang Avenue Singapore 639798 Singapore

Funding

National Research Foundation Singapore

References (100+)

Show source-provided references
1. 10.1016/j.bushor.2018.05.00910.1016/j.bushor.2018.05.009 ↗
2. 10.1016/j.chb.2017.07.03010.1016/j.chb.2017.07.030 ↗
3. Billinghurst M. · New Horiz. Learn. · 2002 · 12 · 1
4. 10.1080/0020754060106477310.1080/00207540601064773 ↗
5. 10.7717/peerj.46910.7717/peerj.469 ↗
6. 10.1155/2017/457417210.1155/2017/4574172 ↗
7. a)R.Frikha R.Ejbali M.Zaied presented at 2016 IEEE/ACS 13th Int. Conf. of Computer Systems and Applications (AICCSA) Morocco November2016;
8. 10.1097/SIH.000000000000041310.1097/SIH.0000000000000413 ↗
9. Sutherland I. E. · 1968 · 757
10. 10.1162/10547460332295595010.1162/105474603322955950 ↗
11. 10.1109/38.96345910.1109/38.963459 ↗
12. 10.1002/admt.20200018110.1002/admt.202000181 ↗
13. 10.1007/978-94-007-0579-1_510.1007/978-94-007-0579-1_5 ↗
14. 10.1007/s00221-015-4346-110.1007/s00221-015-4346-1 ↗
15. 10.1016/j.sna.2007.10.06910.1016/j.sna.2007.10.069 ↗
16. 10.1080/0899022090315879710.1080/08990220903158797 ↗
17. 10.1038/s41586-019-1687-010.1038/s41586-019-1687-0 ↗
18. M.Konyo S.Tadokoro A.Yoshida N.Saiwaki presented at 2005 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems Alberta Canada August2005.
19. Lopes P. · 2015 · 11
20. Lopes P. · 2017 · 1471
21. Konishi Y. · 2016
22. Benko H. · 2016 · 71710.1145/2984511.2984526 ↗
23. 10.1109/TNSRE.2007.89137510.1109/TNSRE.2007.891375 ↗
24. Fujinawa E. · 2017
25. 10.1126/sciadv.aaz869310.1126/sciadv.aaz8693 ↗
26. 10.1016/j.nanoen.2019.10390410.1016/j.nanoen.2019.103904 ↗
27. 10.1002/admi.20170065110.1002/admi.201700651 ↗
28. 10.1038/s41467-019-10061-y10.1038/s41467-019-10061-y ↗
29. 10.1016/j.nanoen.2019.01.07710.1016/j.nanoen.2019.01.077 ↗
30. 10.1109/TIM.2014.234341110.1109/TIM.2014.2343411 ↗
31. Israr A. · 2015
32. 10.1162/pres.18.1.3910.1162/pres.18.1.39 ↗
33. Murakami T. · 2017
34. 10.1145/3025453.302582410.1145/3025453.3025824 ↗
35. E.Kruijff J. E.Swan S.Feiner presented at 2010 IEEE Int. Symp. on Mixed and Augmented Reality Seoul South Korea October2010.
36. 10.3389/fpsyg.2014.0142610.3389/fpsyg.2014.01426 ↗
37. 10.1016/j.neubiorev.2008.07.00910.1016/j.neubiorev.2008.07.009 ↗
38. 10.1016/j.tics.2006.10.01010.1016/j.tics.2006.10.010 ↗
39. 10.1371/journal.pone.009185410.1371/journal.pone.0091854 ↗
40. Ino S. · 1993
41. 10.1162/pres.18.2.15610.1162/pres.18.2.156 ↗
42. 10.3758/BF0319366210.3758/BF03193662 ↗
43. c)H.Choi S.Cho S.Shin H.Lee S.Choi presented at 2018 IEEE Haptics Symposium (HAPTICS) San Francisco CA March2018.
44. L. A.Jones M.Berris presented at 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 2003. HAPTICS March2003.
45. Y.Yoo H.Lee H.Choi S.Choi presented at 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII) Los Angeles CA October2017.
46. a)A.Erickson K.Kim R.Schubert G.Bruder G.Welch presented at 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) Beijing China October2019;
47. b)D.Kurz presented at 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) Munich Germany September2014.
48. Jain D. · 2016 · 72910.1145/2984511.2984519 ↗
49. Peiris R. L. · 2017
50. Ranasinghe N. · 2017
51. Ranasinghe N. · 2018
52. 10.1016/j.brainres.2010.09.03610.1016/j.brainres.2010.09.036 ↗
53. 10.1037/0033-295X.83.2.15710.1037/0033-295X.83.2.157 ↗
54. 10.1016/B978-1-4160-5893-9.00109-X10.1016/B978-1-4160-5893-9.00109-X ↗
55. Tortora G. J. · 1992
56. McGrath J. · 2004 · 4510.1002/9780470750520.ch3 ↗
57. A.Kron G.Schmidt presented at 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 2003 HAPTICS Los Angeles CA March2003.
58. 10.1080/0899022987092510.1080/08990229870925 ↗
59. 10.1016/B978-0-08-021208-1.50028-X10.1016/B978-0-08-021208-1.50028-X ↗
60. 10.1093/brain/114.4.181910.1093/brain/114.4.1819 ↗
61. 10.1007/978-3-642-75076-2_1610.1007/978-3-642-75076-2_16 ↗
62. 10.1016/0031-9384(79)90023-410.1016/0031-9384(79)90023-4 ↗
63. 10.3758/BF0320388510.3758/BF03203885 ↗
64. 10.2307/142185810.2307/1421858 ↗
65. 10.1146/annurev.ph.48.030186.00320510.1146/annurev.ph.48.030186.003205 ↗
66. 10.1016/j.pain.2006.01.04110.1016/j.pain.2006.01.041 ↗
67. 10.1007/978-3-642-75076-2_1610.1007/978-3-642-75076-2_16 ↗
68. Darian‐Smith I. · 2011 · 879
69. 10.1016/j.carbon.2013.07.03010.1016/j.carbon.2013.07.030 ↗
70. 10.1002/mame.20140009710.1002/mame.201400097 ↗
71. 10.1021/acsnano.5b0279010.1021/acsnano.5b02790 ↗
72. 10.1002/adfm.20170600710.1002/adfm.201706007 ↗
73. 10.1002/aelm.20170019310.1002/aelm.201700193 ↗
74. 10.1021/acsami.7b0347410.1021/acsami.7b03474 ↗
75. 10.1021/acsami.7b1051410.1021/acsami.7b10514 ↗
76. 10.1021/nl503657210.1021/nl5036572 ↗
77. 10.1039/C4RA10667A10.1039/C4RA10667A ↗
78. 10.1002/adma.20150091710.1002/adma.201500917 ↗
79. 10.1002/admt.20180043510.1002/admt.201800435 ↗
80. 10.1039/C4NR04151H10.1039/C4NR04151H ↗
81. 10.1186/1556-276X-8-23510.1186/1556-276X-8-235 ↗
82. 10.1002/smll.20140169010.1002/smll.201401690 ↗
83. 10.1016/j.carbon.2013.12.04610.1016/j.carbon.2013.12.046 ↗
84. 10.1039/C5NR04930J10.1039/C5NR04930J ↗
85. 10.1039/C5TC04276C10.1039/C5TC04276C ↗
86. 10.1002/adfm.20120201310.1002/adfm.201202013 ↗
87. 10.1039/D0TA00380H10.1039/D0TA00380H ↗
88. 10.1007/s12274-012-0225-210.1007/s12274-012-0225-2 ↗
89. 10.1021/acs.nanolett.5b0413410.1021/acs.nanolett.5b04134 ↗
90. 10.1039/C4NR06984F10.1039/C4NR06984F ↗
91. 10.1039/C5TC00142K10.1039/C5TC00142K ↗
92. 10.1039/C5TA03348A10.1039/C5TA03348A ↗
93. 10.1021/acsami.6b0929310.1021/acsami.6b09293 ↗
94. 10.1016/j.sna.2013.05.02410.1016/j.sna.2013.05.024 ↗
95. 10.1002/aelm.20160042510.1002/aelm.201600425 ↗
96. 10.1021/nl202311v10.1021/nl202311v ↗
97. 10.1002/smll.20190328110.1002/smll.201903281 ↗
98. 10.1038/3509801210.1038/35098012 ↗
99. 10.1016/j.nanoen.2017.09.01910.1016/j.nanoen.2017.09.019 ↗
100. 10.1126/sciadv.aaw053610.1126/sciadv.aaw0536 ↗