Contemporary audio visualization technologies predominantly reduce sound to amplitude-based representations, obscuring the multidimensional complexity of timbre. This paper examines “Inside Sound,” a room-scale virtual reality installation that transforms spectral audio analysis into navigable three-dimensional space, proposing that physical locomotion through acoustic data constitutes a distinct mode of sonic knowledge. Drawing on Gibson’s ecological approach to perception and theories of embodied cognition, this work argues that walking through constellations of spectral features—Spectral Centroid, Flux, and Spread—reconfigures the epistemological relationship between listener and sound object. Rather than passive audition, participants engage in what we term “navigational listening,” where the body becomes an instrument of timbral analysis. This paper investigates how the transposition of typically invisible acoustic properties into spatial affordances challenges conventional distinctions between listening and looking, creating what we characterize as an “inverted synesthesia.” The analysis reveals implications for sound studies, immersive experience design, and accessibility, arguing that spatial navigation offers cognitive access to sonic dimensions otherwise restricted to computational or expert musical listening.

Authors:
Huoston Rodrigues Batista, RMIT Vietnam, Vietnam

About the Presenter(s)
With over 15 years of experience spanning VFX, animation, and research, Dr. Huoston Rodrigues is a Lecturer in Digital Media at RMIT Vietnam. He specializes in the intersection of embodied digital experiences and generative art.

Connect on Linkedin
https://www.linkedin.com/in/huostonrodrigues

See this presentation on the full schedule – On Demand Schedule

Bookmark