POI is a collaboration with Tim Gmeiner and Eito Murakami. The music was written by Tim, while Eito provided programming support, as well as ideas for the visuals. The song also features Stephanie Richards and King Britt from UCSD. The music was mixed in HOA. The experience works best in Chrome or Firefox. All the song lyrics are by Tim. The assets, such as the photos and models, were borrowed from various online sources. The ambisonic plug-in is powered by Omnitone. Please wear headphones for proper spatial audio with ambisonics 🎧. Three different versions are provided:
HOA <<< LINK (higher order ambisonics) FOA <<< LINK (first order ambisonics) Binaural <<< LINK (static synthesized binaural) Documentation <<< PDF Download <<< ZIPHOA provides the best sound quality, but the file sizes are larger. FOA has smaller file sizes, but still provides head-tracked binaural audio (the sound changes when you change perspectives). Binaural is "static", the sound does not change when you change perspectives, but head related transfer functions have been used. If you are using a personal computer to view this, click and drag on the scene to change perspectives, in HOA and FOA you should hear the sound changing!
DO NOT click the VR button on desktop as it prevents rotational control! If audio does not start automatically you might just need to click the screen.
DOAR (or Bits) is a WebXR installation featuring multi-tile display and spatial audio. The piece uses over 10k audio samples to generate chaotic cacophony in virtual surround sound. Over 400 different images flash in 8 video displays. Above and below the guest, instructions and a poem. This piece was inspired by the scale of classic computer music works by Cage and Varese. The idea behind this piece is an exploration of digital hoarding or virtual greed, characterized by the human instinct to amass and protect data.
Binaural VBAP (octo) <<< LINK (Using WAA) Documentation <<< PDF Download <<< index.htmlDO NOT click the VR button on desktop as it prevents rotational control! If audio does not start automatically you might just need to click the screen.
Continuum is a collaborative VR experience based on the concept of parallel universes. The structure of the musical work is a binary tree in which each layer holds various permutations of an original musical idea. Members worked together on remixing stems into their own realizations which are presented in their individual nodes. In addition to being a conceptual album Continuum is also a foray into spatial audio distribution using WebXR tools. In this case the audio files are passed to the open-source Resonance JS library created by Google within an A-frame scene. A full mix-down of the song at a lower level is also passed to a different visualizer within each layer. The various nodes of each layer besides containing various interpretations of the same musical material also have custom animations, models and color palettes. This experience is designed for mobile devices via Cardboard HMDs and free browsers.
3OA <<< LINK (Using Resonance) Documentation <<< PDF Download <<< index.htmlDO NOT click the VR button on desktop as it prevents rotational control! If audio does not start automatically you might just need to click the screen.