Pensato: Fissure - VR Interface for Ableton Live

• Report rights infringement
• published: 29 Sep 2014
• views: 40284

Fissure is the first piece that I've composed to be played using my VR interface for performing music, Pensato. Performer/Creator: Byron Mallett Filming and cinematography: Szilard Ozorak Tech Discussion: ---------------------- Pensato is a virtual reality interface I've developed for controlling music software and devices using an Oculus Rift and custom VR gloves. Using this system, I can control instruments, trigger sound clips and manipulate effects by interacting with virtual representations of multiple sound devices. The gloves are made from modified Razer Hydra game controllers and are paired with two Teensy microcontrollers equipped with bend sensors for detecting hand my hand gestures. This performance features a master version of Pensato running in Unity on the computer monitor to my right, which creates the visuals for the Rift and controls Ableton Live. The projector computer runs another copy of Pensato that listens to the position and orientation of the gloves, as well as the hand gesture and displays and displays a copy of my VR interface on 3 projectors. The laptop runs Ableton Live 9 and is connected to each copy of Pensato using Showtime, a framework that I developed for connecting together realtime performance software and hardware. This work is the final compositional output for my Masters of Design Innovation: Computer Graphics at Victoria University of Wellington. All audio was captured from the performance and used to create the edited version of the vide.