"Bird-call Window": Edutainment Combining Mixed Reality and Silhouette Puzzles

Abstract

"Bird-call Window" is an interactive installation, which combines an intelligent and collaborative puzzle game and a poetic virtual world. People can request a silhouette puzzle problem on the window's cafe curtain by blowing a bird-call whistle. If they can find the answer, the silhouette of the puzzle pieces changes its shape to a bird and it flies out into a virtual world in the window. Birds stay for a while in the virtual world moving from a branch to another and leave outside the scope. The more frequent players solve the puzzle games, the more they can enjoy watching various and colorful birds in the window. The real time animation is controlled with sound/image recognition technologies. The system is configured with a projector, a speaker, a camera to recognize the puzzle piece alignment and a microphone to recognize the sound.