Dr. Andrew Godbout, candidate for Tenure Track Position in Computer Science, Research Talk entitled "Interactive Rhythmic Sonification", December 4, 2015 at 3:30 pm in Cass Science Hall, Room 104.

The use of sound feedback to assist in learning and correcting motor skills has some innate advantages.  For example, sound leaves a person's eyes free for important tasks like avoiding obstacles, and ample psychological evidence shows a connection between the synthesis and perception of motion and sound.  When motion is periodic, as it is with most forms of human locomotion, the sound feedback should also be periodic, i.e., rhythmic and synchronized to a person's motion. In this talk I will discuss and present computer vision and signal processing techniques for tracking people's movements. I will show how to track the underlying rhythm of a movement using input from cameras and/or wearable sensors. These tracking techniques will exploit the periodic nature of the person's movement to create a tracking signal that is also periodic. I will demonstrate how to use this periodic signal to create and control sound feedback that is synchronized with the movements of the person. This process is called Rhythmic Sonification.
 

All are welcome to attend.  Thank you