Storytelling Meets Music

two people playing vr box
Photo by Michelangelo Buonarroti on Pexels.com

What is the innovation? 

VR/AR paired with music to create a fully immersive experience for art/photography/museum exhibition. Using music to set the scene for the story, while the viewer can navigate the exhibit via virtual/augmented reality. This will create a truly immersive experience where the audience feels like they are part of the story.

Which cultural industries would the innovation apply to? 

Art, Photography and Music

Why/how is it innovative? 

Some artists, museums, and organizations have explored VR and AR to enhance the traditional exhibition experience using things like virtual art galleries and virtual tours of physical museums. 

However, the integration of music or soundscapes to complement the visual elements is a natural extension to create a multi-sensory experience. To further innovate, it will utilise collaborations with musicians and composers to co-create original soundtracks tailored to the virtual environments, fostering a multidisciplinary approach to storytelling through music. 

Additionally, leveraging spatial audio technology to create a more immersive and dynamic audio experience within the VR/AR environments to further enhance the storytelling through music. It would also curate specific moods and conjure cinematic atmospheres using the music to convey a narrative. It will include the integration of haptic feedback to simulate the sense of touch. For example, users could feel vibrations or sensations corresponding to the music, creating a more in-depth and multi-sensory experience. 

Furthermore, it will integrate virtual spaces where users from around the world can join simultaneously to explore exhibitions or attend events. Lastly, the VR environment will enable storytellers to create their own virtual installations or exhibitions.


About this Innovative Idea

This is a sample of a potential project the Innovation Space would consider. It was developed by the following students in the Advertising – Creative and Digital Strategy program:

  • Aaditya Nair
  • Ify Emesibe-Ene
  • Jennifer Abah
  • Joey Chu
  • Kerwin Tagapan
  • Nicolas Sastoque
  • Rachel Dsouza
  • Shaun Roychowdhury
  • Stephie Li

Similar Posts