Mnemo is an application developed for the Microsoft Hololens augmented reality headset, developed by Simon Biggs (artist) and Puzhi Yao (software engineer) at the Creative Computing Studio, University of South Australia. It was developed in Unity 3D using C# and uses speech recognition, speech to text, "gaze" recognition, ray-casting and network protocols to co-locate spoken texts with tangible objects in the environment around the wearer of the Hololens. The software works with multiple head units and wearers, allowing users to see what each other are seeing in the space around them and to generate and share texts within the space. Each wearer’s text is rendered in a distinct colour allowing readers to distinguish between the origin of the different texts. Textual environments can be saved and extended through further interaction with the same or different interactors. Interactors can be co-located or located remotely to one another, allowing the creation of shared spaces at a distance.
Mnemo was premiered at the Transient Topographies symposium at the Moore Institute, National University of Ireland, Galway, in April 2018. Mmemo was also presented at the 2018 Electronic Literature Organization conference in Montreal in August 2018.
Artist and Developer: Simon Biggs
Developer: Puzhi Yao
Read more about Mnemo on Simon Biggs' Website