Skip to content
Sam Bilbow edited this page Dec 8, 2022 · 7 revisions

polaris~

An Audiovisual Augmented Reality Experience Built on Open-Source Hardware and Software

Platform Environment Publication Documentation Project Discord

If an AR system can be thought of as one that combines real and virtual processes, is interactive in real-time, and is registered in three dimensions; why do we witness the majority of AR applications utilising primarily visual displays of information? I propose a practice-led compositional approach for developing multisensory AR experiences’, arguing that, as an medium that combines real and virtual multisensory processes, it must explored with a multisensory approach.

This project uses the open-source Project North Star HMD from Leap Motion alongside bone-conduction headphones to deliver a spatialised audio-visual experience via Unity called polaris~. This repository started off as a fork of the Software Companion for Project North Star, hence the other repository contributors and long list of commits. However, the experience itself including all audio-visual / artistic / musical content was added afterwards.

To get started with polaris~, follow the guide shown on the sidebar of this page. First you may want to familiarise yourself with the components used in the experience and the features they provide.


{Presentation} {Demonstration} {Prototype} {Palm Synth} {Finger Synth} {LibPd Explainer}

Citation

Bilbow, S. (2022). Evaluating polaris~ - An Audiovisual Augmented Reality Experience Built on Open-Source Hardware and Software. NIME 2022. https://doi.org/10.21428/92fbeb44.8abb9ce6

or with BibTeX