CoMo - Collective Movements
CoMo is a JavaScript library that allows developers to create collaborative and gesture-based web applications for mobile devices. It was first developed by IRCAM's ISMM team, in the framework of the RAPIDMIX project I was working on as one of the team's R&D Engineers.
CoMo is also the name of an ecosystem of web applications maintained by the ISMM team and based on the CoMo library.
I was notably involved in the creation of two of these applications (plus a bunch of prototypes) :
CoMo.education
An application for the design of interactive stories for children based on CoMo. It allows teachers to associate various sounds with a collection of gestures, and while telling a story to a group of children get them to play the right sounds at the right moments of the story by performing the right gestures together. The children hold smartphones running a locally distributed app with screens turned off. The only interaction happens through the devices' motion sensors. The sounds are played in real-time on the device's speakers when the associated gestures are detected.
CoMo Education was developed in the framework of Marion Voillot's joint PhD at IRCAM and CRI. It is now a research-creation project carried out by the Premiers Cris association founded by Marion Voillot.
CoMo Elements
The generic web application for gestural control of sounds using smartphones. The gesture/posture can be recorded by the user, and associated wih a series of sounds. Additional sound processing can be programmed through scripts.
