October 19, 2019

Reading Sheet Music in AR with MRTK

I’m creating experiments and tools for myself to read holographic sheet music, along with other music projects in augmented reality. This demo is built with the MRTK and Unity, and my goal is to use it on an AR HMD to keep an organized practice routine that requires no physical sheet music.


Background

I started experimenting with the MRTK with devices like the HoloLens 2 in mind after attending the Mixed Reality Dev Days event at Microsoft’s HQ in Seattle. This video is just a quick demonstration of what’s possible with these new devices and how they can be relevant to music practice and pedagogy!


Future Development

I hope to continue refining these tools so they can be used both in my own practice and as resources for my students and other musicians.