Musical equipment is going in software age by computer's performance advanced and has several advantages with that. Musical Instruments have a long history and many manufacturers keep making a product of practical use many times. On the other hand, electronic musical instrument has very quaint function such as the hardware having many inputs-outputs or ease of use. So, We developed a highly novel software-based MIDI interface which analyzes user's gesture to control electronic musical instruments flexibly in diverse ways.