journal article·2020-02-21Open access

MASS: Microphone Array Speech Simulator in Room Acoustic Environment for Multi-Channel Speech Coding and Enhancement

Rui Cheng, Changchun Bao, Zihao Cui

Applied Sciences· Volume 10· Issue 4

Abstract

Multi-channel speech coding and enhancement is an indispensable technology in speech communication. In order to verify the effectiveness of multi-channel speech coding and enhancement methods in the research and development, a microphone array speech simulator (MASS) used in room acoustic environment is proposed. The proposed MASS is the improvement and extension of the existing multi-channel speech simulator. It aims to simulate clean speech, noisy speech, clean speech with reverberation, noisy speech with reverberation, and noise signals by microphone array used for multi-channel coding and enhancement of speech signal in room acoustic environment. The experimental results of the multi-channel speech coding and enhancement prove that the MASS could well simulate the signals used in real room acoustic environment and can be applied to the research of the related fields.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Speech and Audio Processing · Speech Recognition and Synthesis · Advanced Adaptive Filtering Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Speech and Audio Signal Processing Laboratory, Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China

Funding

National Natural Science Foundation of China

References (31)

Show source-provided references
1. Benesty, J., Chen, J., and Huang, Y. (2008). Microphone Array Signal Processing, Springer.
2. (2020, February 21). Odeon Room Acoustics Software. Available online: http://www.odeon.dk.
3. (2020, February 21). Enhanced Acoustics Simulator for Engineers (EASE). Available online: http://www.auralisation.de.
4. Schimmel, S.M., Muller, M.F., and Dillier, N. (2009, January 19–24). A fast and accurate “shoebox” room acoustics simulator. Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, Taipei, Taiwan.
5. Wabnitz, A., Epain, N., Jin, C.T., and van Schaik, A. (2010, January 29–31). Room acoustics simulation for multichannel microphone arrays. Proceedings of the 2010 International Symposium on Room Acoustics, Melbourne, Australia.
6. Nielsen, J.K., Jensen, J.R., Jensen, S.H., and Christensen, M.G. (2014, January 8–11). The single- and multichannel audio recordings database (SMARD). Proceedings of the 2014 14th International Workshop on Acoustic Signal. Enhancement (IWAENC), Juan-les-Pins, France.10.1109/IWAENC.2014.6953334 ↗
7. Scheibler, R., Bezzam, E., and Dokmanic, I. (2018, January 15–20). Pyroomacoustics: A Python Package for Audio Room Simulation and Array Processing Algorithms. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.10.1109/ICASSP.2018.8461310 ↗
8. The diverse environments multi-channel acoustic noise database: A database of multichannel environmental noise recordings10.1121/1.4806631 ↗
9. Zhang, D., Liu, X., Yan, N., Wang, L., Zhu, Y., and Chen, H. (2014, January 12–14). A multi-channel/multi-speaker articulatory database in Mandarin for speech visualization. Proceedings of the 9th International Symposium on Chinese Spoken Language Processing, Singapore.10.1109/ISCSLP.2014.6936629 ↗
10. Hadad, E., Heese, F., Vary, P., and Gannot, S. (2014, January 8–11). Multichannel audio database in various acoustic environments. Proceedings of the 2014 14th International Workshop on Acoustic Signal Enhancement (IWAENC), Juan-les-Pins, France.10.1109/IWAENC.2014.6954309 ↗
11. Suh, Y., Kim, Y., Lim, H., Goo, J., Jung, Y., Choi, Y., Kim, H., Choi, D.-L., and Lee, Y. (2017, January 1–3). Development of distant multi-channel speech and noise databases for speech recognition by in-door conversational robots. Proceedings of the 2017 20th Conference of the Oriental Chapter of the International Coordinating Committee on Speech Databases and Speech I/O Systems and Assessment (O-COCOSDA), Seoul, Korea.10.1109/ICSDA.2017.8384419 ↗
12. Tang, Z., Chen, L., Wu, B., Yu, D., and Manocha, D. (2020, February 10). Improving reverberant Speech Training Using Diffuse Acoustic Simulation. Available online: https://arxiv.org/abs/1907.03988v4.
13. Drude, L., Heitkaemper, J., Boeddeker, C., and Haeb-Umbach, R. (2019, October 30). SMS-WSJ: Database, Performance Measures, and Baseline Recipe for Multi-Channel Source Separation and Recognition. Available online: https://arxiv.org/abs/1910.13934.
14. Chen, Z., Yoshioka, Y., Lu, L., Zhou, T., Meng, Z., Luo, Y., Wu, J., and Li, J. (2020, January 30). Continuous Speech Separation: Dataset and Analysis. Available online: https://arxiv.org/abs/2001.11482.10.1109/ICASSP40776.2020.9053426 ↗
15. Collected Papers on Acoustics10.1121/1.409944 ↗
16. Generating nonstationary multisensor signals under a spatial coherence constraint10.1121/1.2987429 ↗
17. Garofolo, J.S., Lamel, L.F., Fisher, W.M., Fiscus, J.G., and Pallett, D.S. (1993). DARPA TIMIT Acoustic-Phonetic Continous Speech Corpus CD-ROM. NIST Speech disc 1-1.1, NASA STI/Recon Technical Report N 93, 27403.10.6028/NIST.IR.4930 ↗
18. A Consolidated Perspective on Multimicrophone Speech Enhancement and Source Separation10.1109/TASLP.2016.2647702 ↗
19. Chakrabarty, S., Wang, D., and Habets, E.A.P. (2018, January 17–20). Time-Frequency Masking Based Online Speech Enhancement with Multi-Channel Data Using Convolutional Neural Networks. Proceedings of the 2018 16th International Workshop on Acoustic Signal Enhancement (IWAENC), Tokyo, Japan.10.1109/IWAENC.2018.8521346 ↗
20. Panayotov, V., Chen, G., Povey, D., and Khudanpur, S. (2015, January 19–24). Librispeech: An ASR corpus based on public domain audio books. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, QLD, Australia.10.1109/ICASSP.2015.7178964 ↗
21. Rix, A.W., Beerends, J.G., Hollier, M.P., and Hekstra, A.P. (2001, January 7–11). Perceptual evaluation of speech quality (PESQ)-a new method for speech quality assessment of telephone networks and codecs. Proceedings of the 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing, Salt Lake City, UT, USA.
22. An algorithm for intelligibility prediction of time–frequency weighted noisy speech10.1109/TASL.2011.2114881 ↗
23. 3GPP TS 26.445 (2019, June 14). Codec for Enhanced Voice Services (EVS); Detailed Algorithmic Description. Available online: https://portal.3gpp.org/desktopmodules/Specifications/SpecificationDetails.aspx?specificationId=1467.
24. 3GPP TS 26.071 (2018, June 22). Mandatory Speech CODEC Speech Processing Functions; AMR Speech Codec; General Description. Available online: https://portal.3gpp.org/desktopmodules/Specifications/SpecificationDetails.aspx?specificationId=1386.
25. 3GPP TS 26.171 (2018, June 22). Speech Codec Speech Processing Functions; Adaptive Multi-Rate -Wideband (AMR-WB) Speech Codec; General Description. Available online: https://portal.3gpp.org/desktopmodules/Specifications/SpecificationDetails.aspx?specificationId=1420.
26. Dietz, M., Multrus, M., Eksler, V., Malenovsky, V., Norvell, E., Pobloth, H., Miao, L., Wang, Z., Laaksonen, L., and Vasilache, A. (2015, January 19–24). Overview of the EVS codec architecture. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, QLD, Australia.10.1109/ICASSP.2015.7179063 ↗
27. Robust time delay estimation exploiting redundancy among multiple microphones10.1109/TSA.2003.818025 ↗
28. Hansen, J.H.L., and Pellom, B.L. (December, January 30). An Effective Quality Evaluation Protocol For Speech Enhancement Algorithms. Proceedings of the 5th International Conference on Spoken Language Processing, Sydney, Australia.
29. Simultaneous Detection and Estimation Approach for Speech Enhancement10.1109/TASL.2007.904231 ↗
30. Speech Dereverberation Based on Variance-Normalized Delayed Linear Prediction10.1109/TASL.2010.2052251 ↗
31. Higuchi, T., Ito, N., Yoshioka, T., and Nakatani, T. (2016, January 20–25). Robust MVDR beamforming using time-frequency masks for online/offline ASR in noise. Proceedings of the 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China.10.1109/ICASSP.2016.7472671 ↗