Immersive Audio Design Tools: Exploring Affordances and Interaction Modalities for Spatial Sound Experiences

Thesis 2024
Yanting Deng (MSCD 2024)
graphic of spheres

Committee: Joshua Bard, Daniel Rosenberg
Abstract: This thesis discusses the modalities of an immersive soundscape design system, Sound Hologram. This system is developed with wavefield synthesis (WFS) and motion tracking. The thesis introduces the current state of the art and discusses issues of spatial sound synthesis in the development of computer-aided composition, as well as common problems of existing interfaces such as the need for advanced controlling mechanics. The design of a new interface is presented, comprising three software integrated in a technical stack, providing convenience for designers prototyping soundscapes. A user test is presented with quantitative and qualification evaluations of this interface, concluding with general guidelines for interface design and future development.