Musical Instrument Performance Control by IR-LED Sensor-Based Gesture Recognition
Details
It is difficult for many people to conduct actual orchestras. We have developed a virtual orchestra system which is conducted by recognizing gestures of swinging a baton as a conductor. The baton is attached infra-red LEDs and conducting gestures of the baton is sensed by a infra-red camera. Conducting gestures are recognized under actual orchestral conducting methods by employing Hidden Markov Model. The conductor can also control tempo of music freely.
