Abstract
Garden Aqua is a tangible user interface (TUI) that interacts with several balls floating over a water stream. Water is pumped up from the nozzles of several water pumps, and the ball floats above the water stream as a medium. The motion sensor at the top of the Garden Aqua detects the user's hand gesture, and the sensor allows the user to change the position of the ball and adjust the height of the water stream in real time. To apply Garden Aqua system to application works, we have created the Tone Matrix which composes a music of symphonious harmony using a user’s hand position and motion. And it was exhibited at Siggraph Asia 2013. In addition, we analyzed the elements of TUI framework of two representative studies and Tone Matrix. Tone Matrix has most elements of TUI. The partially contained haptic direct manipulation element can be supplemented by an intuitive gesture control using motion sensors. It is expected that this study helps carry out further studies on TUI in practice and by analyzing TUI elements.