From analog drum machines to vintage guitars, orchestral percussion to circuit-bent children’s toys, 1980s Russian synthesizers to Indian harmoniums…these are the instruments of Robot Repair.
This project combines the collective talents of musicians, dancers, programmers, designers and animators to create an amazing visual instrument. Creating music through motion is at the heart of this creation and uses the power of the Kinect to capture movement and translate it into music which is performed live and projected on a huge wall.
We created and designed the live visual spectacle with a music video being produced from the results. We wanted it to be clear that the technology was real and actually being played live. The interface plays a key role in illustrating the idea of the instrument and we designed it to highlight the audio being controlled by the dancer. Design elements like real time tracking and samples being drawn on as they are played all add to authenticity of the performance. The visuals are all created live and the music video is essentially a real document of the night.
Check out the tech behind the project here: custom-logic.com/blog/v-motion-project-the-instrument/
Find out more on: http://labs.official.fm/codecs/flac/
Do Kinect-like things on your computer, but without the Kinect: the technique uses your speakers and microphone to sense what gesture you are making.
Gesture is becoming an increasingly popular means of interacting with computers. However, it is still relatively costly to deploy robust gesture recognition sensors in existing mobile platforms. We present SoundWave, a technique that leverages the speaker and microphone already embedded in most commodity devices to sense in-air gestures around the device. To do this, we generate an inaudible tone, which gets frequency-shifted when it reflects off moving objects like the hand. We measure this shift with the microphone to infer various gestures. In this note, we describe the phenomena and detection algorithm, demonstrate a variety of gestures, and present an informal evaluation on the robustness of this approach across different devices and people.
Find out more on: http://research.microsoft.com/en-us/um/redmond/groups/cue/soundwave/