Virtual and augmented reality: Human sensory‐perceptual requirements and trends for immersive spatial computing experiences
Source abstract
Abstract
Abstract Building on several decades of research and development, the recent progress in virtual reality (VR) and augmented reality (AR) devices with spatial computing technologies marks a significant leap in human–computer interaction, with applications ranging from entertainment and education to e‐commerce and healthcare. Advances in these technologies promise immersive experiences by simulating and augmenting the real world with computer‐generated digital content. The core objective of the VR and AR systems is to create convincing human sensory perceptions, thereby creating immersive and interactive experiences that bridge the gap between virtual and physical realities. However, achieving true immersion remains a goal, and it necessitates a comprehensive understanding of the neuroscience of human multisensory perception and accurate technical implementations to create a consistency between natural and synthetic sensory cues. This paper reviews the human sensory‐perceptual requirements vital for achieving such immersion, examines the current status and challenges, and discusses potential future advancements.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Tactile and Sensory Interactions · Virtual Reality Applications and Impacts · Visual Attention and Saliency Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Starkey Hearing Eden Prairie Minnesota USA
Stanford University Stanford California USA
References (100+)
Show source-provided references
1. Sensorama Heilig M. · 1962
2. Sutherland IE · 1968 · 757
3. Mazuryk T · 1999
4. Burdea GC · 2003 · 663
5. 10.1007/978-94-007-6910-610.1007/978-94-007-6910-6 ↗
6. Lanier J · 2017
7. 10.1002/sdtp.1156410.1002/sdtp.11564 ↗
8. Bhowmik AK · 2017
9. 10.3389/fpsyg.2018.0208610.3389/fpsyg.2018.02086 ↗
10. 10.1002/j.2637-496X.2018.tb01117.x10.1002/j.2637-496X.2018.tb01117.x ↗
11. LaValle SM · 2019
12. 10.1177/107118132064130010.1177/1071181320641300 ↗
13. Sisler W. · 1985
14. Tassi P · 2017
15. Pogue D · 2024
16. 10.3390/ijerph19181127810.3390/ijerph191811278 ↗
17. 10.1038/d41586-018-04997-210.1038/d41586-018-04997-2 ↗
18. 10.1201/9781003340133-310.1201/9781003340133-3 ↗
19. 10.1007/11418337_310.1007/11418337_3 ↗
20. 10.2196/2549910.2196/25499 ↗
21. 10.1021/es103907m10.1021/es103907m ↗
22. 10.3390/diagnostics1305089210.3390/diagnostics13050892 ↗
23. 10.3390/jcm912381110.3390/jcm9123811 ↗
24. 10.4103/2152-7806.8011710.4103/2152-7806.80117 ↗
25. 10.1016/j.ijsu.2016.10.00310.1016/j.ijsu.2016.10.003 ↗
26. 10.1097/00000658-200210000-0000810.1097/00000658-200210000-00008 ↗
27. 10.1002/ase.169610.1002/ase.1696 ↗
28. 10.1002/14651858.CD010760.pub210.1002/14651858.CD010760.pub2 ↗
29. 10.1016/j.cpr.2022.10221310.1016/j.cpr.2022.102213 ↗
30. 10.1002/jts.2057410.1002/jts.20574 ↗
31. 10.1371/journal.pone.004846910.1371/journal.pone.0048469 ↗
32. 10.1089/10949310232101816910.1089/109493102321018169 ↗
33. 10.2217/pmt.10.1510.2217/pmt.10.15 ↗
34. 10.3109/0963828970916653010.3109/09638289709166530 ↗
35. 10.2307/2514870510.2307/25148705 ↗
36. 10.2196/1295910.2196/12959 ↗
37. 10.1001/jama.2017.2080010.1001/jama.2017.20800 ↗
38. 10.1016/j.compedu.2020.10400510.1016/j.compedu.2020.104005 ↗
39. Designing VR experiences—expectations for teaching and learning in VR
40. 10.1371/journal.pone.027626710.1371/journal.pone.0276267 ↗
41. 10.1109/EDUCON.2011.577322310.1109/EDUCON.2011.5773223 ↗
42. Seu E · 2018
43. 10.1177/1063293X1456881410.1177/1063293X14568814 ↗
44. 10.1016/j.autcon.2017.11.00310.1016/j.autcon.2017.11.003 ↗
45. 10.3390/su1105147710.3390/su11051477 ↗
46. Wyk E · 2009 · 53
47. 10.1016/j.promfg.2018.07.14010.1016/j.promfg.2018.07.140 ↗
48. 10.1080/15228835.2019.158733410.1080/15228835.2019.1587334 ↗
49. 10.1016/j.jnca.2020.10297010.1016/j.jnca.2020.102970 ↗
50. 10.1109/93.84842710.1109/93.848427 ↗
51. 10.1515/pdtc-2020-001710.1515/pdtc-2020-0017 ↗
52. 10.1002/978047099464110.1002/9780470994641 ↗
53. 10.1111/cgf.1365410.1111/cgf.13654 ↗
54. 10.1016/j.isci.2020.10139710.1016/j.isci.2020.101397 ↗
55. 10.1038/s41377-021-00658-810.1038/s41377-021-00658-8 ↗
56. 10.1126/science.abq701110.1126/science.abq7011 ↗
57. 10.1117/3.255930410.1117/3.2559304 ↗
58. 10.3724/SP.J.2096-5796.2018.000910.3724/SP.J.2096-5796.2018.0009 ↗
59. 10.1109/JDT.2006.87984610.1109/JDT.2006.879846 ↗
60. 10.1002/978111870623710.1002/9781118706237 ↗
61. A survey of tracking technology for virtual environments
62. 10.1109/EnT.2019.0002210.1109/EnT.2019.00022 ↗
63. 10.3390/s1705103710.3390/s17051037 ↗
64. Newcombe RA · 2320
65. 10.1109/TASE.2016.258275210.1109/TASE.2016.2582752 ↗
66. 10.1016/j.compind.2015.05.00310.1016/j.compind.2015.05.003 ↗
67. 10.3390/s2109314510.3390/s21093145 ↗
68. 10.1002/9781118706237.ch110.1002/9781118706237.ch1 ↗
69. 10.1007/s00371-023-03175-410.1007/s00371-023-03175-4 ↗
70. 10.3724/SP.J.2096-5796.2018.000610.3724/SP.J.2096-5796.2018.0006 ↗
71. 10.1002/9781118706237.ch410.1002/9781118706237.ch4 ↗
72. 10.3390/app1019685010.3390/app10196850 ↗
73. 10.1016/j.patcog.2019.04.02610.1016/j.patcog.2019.04.026 ↗
74. 10.1007/s00371-021-02263-710.1007/s00371-021-02263-7 ↗
75. Eye DH · 2014 · 251
76. 10.16910/jemr.12.1.310.16910/jemr.12.1.3 ↗
77. 10.1007/s10055-022-00738-z10.1007/s10055-022-00738-z ↗
78. 10.1016/j.cag.2018.04.00210.1016/j.cag.2018.04.002 ↗
79. 10.3389/fnins.2017.0019710.3389/fnins.2017.00197 ↗
80. 10.1145/765891.76598210.1145/765891.765982 ↗
81. 10.1145/297857710.1145/2978577 ↗
82. 10.1007/978-1-4471-6392-3_310.1007/978-1-4471-6392-3_3 ↗
83. 10.1007/s10055-018-0371-210.1007/s10055-018-0371-2 ↗
84. 10.1145/3131277.313218010.1145/3131277.3132180 ↗
85. Piumsomboon T · 36
86. 10.1016/j.compedu.2022.10468110.1016/j.compedu.2022.104681 ↗
87. 10.1007/s10055-023-00903-y10.1007/s10055-023-00903-y ↗
88. 10.1145/3379157.339142110.1145/3379157.3391421 ↗
89. 10.1002/9781118706237.ch310.1002/9781118706237.ch3 ↗
90. 10.1109/ACCESS.2019.289688010.1109/ACCESS.2019.2896880 ↗
91. 10.1016/j.eswa.2020.11319310.1016/j.eswa.2020.113193 ↗
92. 10.1080/15421406.2017.128962410.1080/15421406.2017.1289624 ↗
93. 10.1002/9781118706237.ch910.1002/9781118706237.ch9 ↗
94. 10.1002/sdtp.1260210.1002/sdtp.12602 ↗
95. 10.36463/idw.2019.000910.36463/idw.2019.0009 ↗
96. 10.1007/s10055-023-00753-810.1007/s10055-023-00753-8 ↗
97. 10.1162/pres.1997.6.4.43310.1162/pres.1997.6.4.433 ↗
98. 10.1109/ISUVR.2008.1010.1109/ISUVR.2008.10 ↗
99. 10.3389/frvir.2021.72193310.3389/frvir.2021.721933 ↗
100. 10.1145/356502010.1145/3565020 ↗