Using new interactive technologies to improve learning and health
Open University teams have developed technologies involving new forms of fluid, that are influencing practice in areas such as violin teaching, the theatre, and gait rehabilitation for stroke patients.
Some of these technologies involve haptic interaction (communication by sense of touch), such as the MusicJacket created by Dr Janet van der Linden and colleagues at the OU's Computing Department. Partly funded through the Arts and Humanties Research Council e-Sense project, the MusicJacket uses motion-capture technology to record a violin player's movement and then gives real-time, vibrotactile feedback on the correctness of their bowing. When needed, gentle buzzes nudge players to an improved pattern of movement.
"When we used the MusicJacket in schools, as part of regular violin lessons, we found that children as young as six were able to improve their posture and play better," says Dr van der Linden.
The Haptic Bracelets, created by Dr Simon Holland and colleagues, are wireless bracelets worn on all four limbs (wrists and ankles). These were designed for musical purposes, but have found applications in Stroke and Parkinson's rehabilitation.
When used for drum tuition, students can directly feel (and record for later playback - in slow motion if needed) the teacher's limb movements.
At a meeting of the Association of Chartered Physiotherapists with interests in Neurology, 90 per cent of members responding to a participative demonstration, and 91 per cent of NHS physiotherapists at a hands-on workshop organised by the Stroke Research Network, agreed that the bracelets have the potential to influence practice in Stroke and Parkinson's rehabilitaiton.
"A team of neuroscientists in Birmingham in collaboration with the NHS physiotherapists, is now carrying out pilot trials," explains Dr Holland.
A very different device, the Haptic Lotus, sits in the palm of the user's hand and gives feedback through opening and closing its petals when a person is moving through a space. The device was developed in collaboration with blind artist, Maria Oshodi, and robotics engineer, Adam Spiers. Of some 150 blind and sighted people who took part in a haptic theatre experience at London's Battersea Arts Centre in 2010, many reported that the Haptic Lotus provided a strong sense of reassurance in the dark.
- J. van der Linden, Y. Rogers, M. Oshodi, A. Spiers, D. Mcgoran, R. Cronin, P. O'Dowd. Haptic Reassurance in the Pitch Black for an Immersive Theatre Experience.
- Holland, S., Bouwer, A., Dalgleish, M., & Hurtig, T. (2010). Feeling the Beat where it counts: Fostering Multi-limb Rhythm Skills with the Haptic Drum Kit. In Proceedings of TEI 2010 Pages 21-28. ACM New York NY USA.
- J. van der Linden, E. Schoonderwaldt, J. Bird, R. Johnson. MusicJacket - Combining Motion Capture and Vibrotactile Feedback to Teach Violin Bowing. In: IEEE Transactions on Instrumentation and Measurements, 60(1), pp. 104–113. 2011
- J. van der Linden, R. Johnson, J. Bird, Y. Rogers, E. Schoonderwaldt (2011) Buzzing to Play: Lessons learned from an in the wild study of real-time vibrotactile feedback. Proceedings of the 29th International Conference on Human Factors in Computing Syste
- A.Bowers, S.Holland, M.Dalgleish: The Haptic Bracelets: learning multi-limb rhythm skills from haptic stimuli while reading
