Do you play a musical instrument? Are you tired of scrambling to flip pages or carrying around a foot pedal? Turnit will solve your problem! Our app allows you to upload multiple sheet music images and, whenever you're ready, listens to you play and displays sheet music image to you one by one, timed to flip at the right time.
We initially built this app as the final project for CPSC459/559 "Building Interactive Machines", where we combined computer vision algorithms (mainly template matching) with audio processing techniques to create an integrated system. We won the Class Choice Award 🏆, given to the top project in class. For a demo, check out this video 🎬. For more technical details, check out our accompanying paper 📃. You can find the source code for this version under the version_1/ directory.
We're currently developing the second version for the app to handle more complex music by applying deep learning techniques.