Singing Graphics in VR: Exhibition and Playtest

An exhibition of two VR artworks by Adinda van ’t Klooster:  the AudioVirtualizer  (2019) and VRoar (2023).

These VR experiences are more art than games, though they reside somewhere in the middle. Instead of chasing around collecting objects or winning from an opponent, the aim is simply to explore and wander, to listen and observe and to be playful with the voice. 

The AudioVirtualizer teleports users from one scene to the next by clicking on the dildo-like sculpture. It runs on the HTC Vive-Pro Virtual Reality headset, with graphics generated live in response to changes in low and mid-level sound features. The user can choose one of four soundtracks or live microphone input to see how the graphics respond to the different the sound features. The use of scanned-in ink drawings creates a strong sense of materiality in the essentially digital landscape. 

The VRoar art game allows the user to see their vocal expression directly affect the graphics in a surreal landscape. By experimenting with their voice and making unusual vocal utterances, the user moves textured blobs around in a desert landscape. Trees are created by moving through the landscape using the controllers and looking in a particular direction. All the elements in a scene pulse and distort through expressive voice control. Surreal clouds distort and dance based on the sound you make. 

We are currently evaluating these interfaces through questionnaires. Attendees at the exhibition are also invited to participate in an evaluation of the interfaces to find out how they affect people’s moods. By participating in the study, you can help us design the next interface. You can book a private slot to experience the interfaces and participate in the questionnaire by emailing [email protected]. Private slots can be booked on Thursday 28 November, Friday the 29 November, Monday 2 December and Thursday 5 December between 10:00am and 4:00pm. It takes about 20 minutes to participate, and you will receive a £10 Amazon voucher to thank you for your time.

This exhibition will end with a launch of the Emote VR Voicer project on Thursday 5 December from 12:00 - 2:00pm. Tea, coffee and cake will be served, and all are welcome to attend. 

 In the AudioVirtualizer and VRoar interfaces, the graphics and system design are by Adinda van ’t Klooster, and machine-listening tech and Unity programming by Nick Collins, with additional Unity VR programming by Nathan Flounders in the AudioVirtualizer.

The AudioVirtualizer was funded by Northern Bridge through a postdoctoral fellowship at Durham University in 2019.

VRoar received Arts Council England funding in 2021. The Emote VR Voicer project is supported by the Arts and Humanities Research Council [AH/Z506618/1], Manchester Metropolitan University, the Manchester Game Centre and Edge Hill University. The Emote VR Voicer project will run from September 2024 until March 2027.