A Methodology Proposal for the Evaluation and Ranking of 3D Sound Attributes

Year 2024, Volume: 7 Issue: 1, 87 - 109, 31.07.2024

Laçin Şahin , Can Karadoğan

Abstract

This study proposes a method for evaluation and ranking attributes in 3D audio based on their functionality. According to the proposed method, a list of attributes is created from the existing research about surround and 3D sound attributes. The Semantic Differential Scale is suggested as an evaluation method. Dimensions for the semantic differential scale are offered, which are importance, comprehensibility, and noticeability. The methodology uses a weight assignment process based on expert panel opinions, minimizing individual error. The weighted average scores from the assessors that participate in the evaluation phase are combined to create a functionality score. This score is used to rank the attributes according to their functionality, which is the operationalized result of three dimensions. The study also suggests providing musical context to subjects during evaluation, allowing them to focus on the attributes. Finally, procedures such as data arrangement, rank listing, statistical and comparative analysis methods are explained.

Keywords

3D sound, 3D sound attributes, semantic differential scale, listening test, statistical analysis

Supporting Institution

İSTANBUL TEKNİK ÜNİVERSİTESİ

Project Number

43720

References

• Bech, S. & Zacharov, N. (2006). Perceptual audio evaluation: theory, method and application. John Wiley & Sons.
• Berg, J., & Rumsey, F. (2001, June 21-24). Verification and correlation of attributes used for describing the spatial quality of reproduced sound [Paper presentation]. Audio Engineering Society 19th International Conference, Schloss Elmau, Germany.
• Choisel, S., & Wickelmaier, F. (2007). Evaluation of multichannel reproduced sound: Scaling auditory attributes underlying listener preference. Journal of the Acoustical Society of America, 121(1), 388-400.
• Cozby, P. C., & Bates, S. C. (2018). Methods in behavioral research (13th ed.). McGraw Hill Education
• European Broadcasting Union (1997). Assessment methods for the subjective evaluation of the quality of sound programme material – Music (EBU Tech 3286-E). https://www.ebu.ch/home
• European Broadcasting Union (2000). Assessment methods for the subjective evaluation of the quality of sound programme material – Supplement 1 - Multichannel (EBU Tech 3286-E). https://www.ebu.ch/home
• Francombe, J., Brookes, T., & Mason, R. (2017). Evaluation of spatial audio reproduction methods (part 1): Elicitation of perceptual differences. Journal of the Audio Engineering Society, 65(3), 198-211.
• Gabrielsson, A., & Sjögren, H. (1979). Perceived sound quality of sound-reproducing systems. Journal of the Acoustical Society of America, 65(4), 1019–1033.
• Guastavino, C., & Katz, B. F. G. (2004). Perceptual evaluation of multi-dimensional spatial audio reproduction. Journal of the Acoustical Society of America, 116(2), 1105–1115.
• Hamasaki K., Nishiguchi, T., Hiyama K., & Okumura R. (2006, May 20-23). Effectiveness of height information for reproducing presence and reality in multichannel audio system [Paper presentation]. Audio Engineering Society 120th Convention, Paris, France.
• Howie, W., Martin, D., Benson, D. H., Kelly, J., & King, R. (2018, August 7-9). Subjective and objective evaluation of 9ch three-dimensional acoustic music recording techniques [Paper presentation]. AES International Conference on Spatial Reproduction - Aesthetics and Science, Tokyo, Japan.
• Howie, W., Martin, D., Kim, S., Kamekawa, T., & King, R. (2019). Effect of audio production experience, musical training, and age on listener performance in 3D audio evaluation. Journal of the Audio Engineering Society, 67(10), 782–794.
• International Telecommunication Union (1997). Methods for the subjective assessment of small impairments in audio systems including multichannel sound systems (ITU-R BS.1116-1) https://www.itu.int/dms_pubrec/itu-r/rec/bs/R-REC-BS.1116-1-199710-S!!PDF-E.pdf
• International Telecommunication Union (2015). Methods for the subjective assessment of small impairments in audio systems: broadcasting service (sound) (ITU-R BS.1116-3). https://www.itu.int/rec/R-REC-BS.1116-3-201502-I/en
• International Telecommunication Union (2022). Advanced sound system for programme production: broadcasting service (sound) (ITU-R BS.2051-3). https://www.itu.int/rec/R-REC-BS.2051-3-202205-I/en
• Koivuniemi, K., & Zacharov, N. (2001, September 21-24). Unravelling the perception of spatial sound reproduction: Language development, verbal protocol analysis and listener training [Paper presentation]. Audio Engineering Society 111th Convention, New York, NY, United States.
• Le Bagousse, S., Colomes, C., & Paquier, M. (2010a, June 13-15). State of the art on subjective assessment of spatial sound quality [Paper presentation]. Audio Engineering Society 38th International Conference, Piteå, Sweden.