journal article·2024-09-06Open access

Assessing Ambisonics Sound Source Localization by Means of Virtual Reality and Gamification Tools

Esaú Medina, Rhoddy Viveros-Muñoz, Felipe Otondo

Applied Sciences· Volume 14· Issue 17

Abstract

Sound localization is a key area of interest in auditory research, especially in complex acoustic environments. This study evaluates the impact of incorporating higher-order Ambisonics (HOA) with virtual reality (VR) and gamification tools on sound source localization. The research addresses the current limitations in VR audio systems, particularly the lack of native support for HOA in game engines like Unreal Engine (UE). A novel framework was developed, combining UE for VR graphics rendering and Max for HOA audio processing. Participants performed sound source localization tasks in two VR environments using a head-mounted display (HMD). The assessment included both horizontal and vertical plane localization. Gamification elements were introduced to improve engagement and task comprehension. Results showed significant improvements in horizontal localization accuracy, although challenges remained in back localization. The findings underscore the potential of VR and gamification to enhance auditory tests, reducing test duration and participant fatigue. This research contributes to the development of immersive and interactive audio experiences, highlighting the broader applications of VR beyond entertainment.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Noise Effects and Management · Hearing Loss and Rehabilitation · Vehicle Noise and Vibration Control

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Arts and Technology Lab, Institute of Acoustics, Universidad Austral, Valdivia 5110701, Chile

Departamento de Electrónica e Informática, Universidad Técnica Federico Santa María, Sede Concepción, Hualpén 4601086, Chile

Funding

Chilean National Fund for Scientific and Technological Development (FONDECYT) · ANID FONDECYT de Postdoctorado

References (41)

Show source-provided references
1. Barlow, C., Michailidis, T., Meadow, G., Gouch, J., and Rajabally, E. (2019, January 27–29). Using immersive audio and vibration to enhance remote diagnosis of mechanical failure in uncrewed vessels. Proceedings of the Audio Engineering Society Conference: 2019 AES International Conference on Immersive and Interactive Audio 2019, York, UK.
2. Gorzynski, S., Kaplanis, N., and Bech, S. (2020, January 27–30). A flexible software tool for perceptual evaluation of audio material and VR environments. Proceedings of the Audio Engineering Society Convention 149 2020, Online.
3. Hupke, R., Ordner, J., Bergner, J., Nophut, M., Preihs, S., and Peissig, J. (2019, January 27–29). Towards a Virtual Audiovisual Environment for Interactive 3D Audio Productions. Proceedings of the Audio Engineering Society Conference: 2019 AES International Conference on Immersive and Interactive Audio 2019, York, UK.
4. Perceptual Evaluation: Listening Strategies, Methods, and VR
5. Boukhris, S., and Menelas, B.-A.J. (2017, January 9–14). Towards the Use of a Serious Game to Learn to Identify the Location of a 3D Sound in the Virtual Environment. Proceedings of the Human-Computer Interaction. Interaction Contexts: 19th International Conference 2017, Vancouver, BC, Canada.10.1007/978-3-319-58077-7_3 ↗
6. Wu, Y.-H., and Roginska, A. (2019, January 27–29). Analysis and training of human sound localization behavior with VR application. Proceedings of the Audio Engineering Society Conference: 2019 AES International Conference on Immersive and Interactive Audio 2019, York, UK.
7. Frank, M., and Perinovic, D. (2023, January 23–25). Recreating a multi-loudspeaker experiment in virtual reality. Proceedings of the Audio Engineering Society Conference: AES 2023 International Conference on Spatial and Immersive Audio 2023, Huddersfield, UK.
8. Huisman, T., Ahrens, A., and MacDonald, E. (2021). Ambisonics Sound Source Localization with Varying Amount of Visual Information in Virtual Reality. Front. Virtual Real., 2.10.3389/frvir.2021.722321 ↗
9. Rees-Jones, J., and Murphy, D. (2017, January 5–9). A Comparison Of Player Performance In A Gamified Localisation Task Between Spatial Loudspeaker Systems. Proceedings of the 20th International Conference on Digital Audio Effects 2017, Edinburgh, Scotland.
10. Zotter, F., and Frank, M. (2019). Springer Topics in Signal Processing Ambisonics A Practical 3D Audio Theory for Recording, Studio Production, Sound Reinforcement, and Virtual Reality, Springer Nature.10.1007/978-3-030-17207-7 ↗
11. Frank, M., Zotter, F., and Sontacchi, A. (2015, January 6–8). Producing 3D Audio in Ambisonics. Proceedings of the Audio Engineering Society Conference: 57th International Conference: The Future of Audio Entertainment Technology–Cinema, Television and the Internet 2015, Hollywood, CA, USA.
12. The impact of a visual spatial frame on real sound-source localization in virtual reality10.1016/j.crbeha.2020.100003 ↗
13. (2024, July 27). Native Soundfield Ambisonics Rendering in Unreal Engine|Unreal Engine 5.4 Documentation|Epic Developer Community. Available online: https://dev.epicgames.com/documentation/en-us/unreal-engine/native-soundfield-ambisonics-rendering-in-unreal-engine.
14. (2024, July 27). What is Max?|Cycling ’74. Available online: https://cycling74.com/products/max.
15. Aguilar, M. (2023). Implementación y Evaluación de un Diseño Sonoro en Formato 3D-Ambisonics. [Undergraduate Thesis, Universidad Austral de Chile].
16. Free-Field Localization Performance with a Head-Tracked Virtual Auditory Display10.1109/JSTSP.2015.2421874 ↗
17. Moraes, A.N., Flynn, R., Hines, A., and Murray, N. (2020, January 26–28). Evaluating the User in a Sound Localisation Task in a Virtual Reality Application. Proceedings of the 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), Athlone, Ireland.10.1109/QoMEX48832.2020.9123136 ↗
18. Power, P., Dunn, C., Davies, B., and Hirst, J. (2013). Localisation of Elevated Sources in Higher-Order Ambisonics. BBC Res. Dev. White Pap. WHP, 261.
19. Sochaczewska, K., Malecki, P., and Piotrowska, M. (2021, January 8–10). Evaluation of the Minimum Audible Angle on Horizontal Plane in 3rd order Ambisonic Spherical Playback System. Proceedings of the 2021 Immersive and 3D Audio: From Architecture to Automotive 2021, Bologna, Italy.10.1109/I3DA48870.2021.9610858 ↗
20. Rudzki, T., Gomez-Lanzaco, I., Stubbs, J., Skoglund, J., Murphy, D.T., and Kearney, G. (2019). Auditory localization in low-bitrate compressed Ambisonic scenes. Appl. Sci., 9.10.3390/app9132618 ↗
21. Thresh, L. (2017). A Direct Comparison of Localization Performance When Using First, Third, and Fifth Ambisonics Order for Real Loudspeaker and Virtual Loudspeaker. J. Audio Eng. Soc., 9864.
22. Piotrowska, M., Bogus, P., Pyda, G., and Malecki, P. (2024, January 15–17). Virtual Reality as a Tool for Investigating Auditory Perception. Proceedings of the Audio Engineering Society 156th Convention 2024, Madrid, Spain.
23. Toward Sound Localization Testing in Virtual Reality to Aid in the Screening of Auditory Processing Disorders10.1177/23312165241235463 ↗
24. The Soundlapse Project Exploring Spatiotemporal Features of Wetland Soundscapes10.1162/leon_a_02142 ↗
25. Fernández, J. (2023). Diseño y Evaluación Perceptual de un Algoritmo de Epacialización Sonora en Formato Ambisonics. [Undergraduate Thesis, Universidad Austral de Chile].
26. Spat: A comprehensive toolbox for sound spatialization in Max
27. (2024, July 27). LATE|Laboratorio de Arte y Tecnología. Available online: https://soundlapse.net/latelab/.
29. Batschelet, E. (1981). Circular Statistics in Biology, Academic Press. Mathematics in Biology.
30. A Multi-Sample Uniform Scores Test on a Circle and its Parametric Competitor10.1111/j.2517-6161.1972.tb00891.x ↗
31. On the resultant of a large number of vibrations of the same pitch and of arbitrary phase10.1080/14786448008626893 ↗
32. A Bivariate Sign Test10.1214/aoms/1177728498 ↗
33. Circular Statistics in Biology10.2307/1267831 ↗
34. Statistics of Directional Data10.1111/j.2517-6161.1975.tb01550.x ↗
35. Hartmann, W.M. (2021). Localization and Lateralization of Sound. Binaural Hearing: With 93 Illustrations, Springer.10.1007/978-3-030-57100-9_2 ↗
36. Resolution of front-back ambiguity in spatial hearing by listener and source movement10.1121/1.426899 ↗
37. Energy-Preserving Ambisonic Decoding10.3813/AAA.918490 ↗
38. The Encoding of Sound Source Elevation in the Human Auditory Cortex10.1523/JNEUROSCI.2530-17.2018 ↗
39. Sound Source and Loudspeaker Base Angle Dependency of the Phantom Image Elevation Effect10.17743/jaes.2017.0028 ↗
40. Lee, H. (2021). Psychoacoustics of height perception in 3D audio. 3D Audio, Routledge.10.4324/9780429491214-5 ↗
41. Using virtual reality to assess auditory performance10.1097/01.HJ.0000558464.75151.52 ↗