User Interfaces exploiting camera-equipped mobile terminals

Abstract

This paper proposes user interfaces with cameras equipped on mobile terminals. The interfaces support users to obtain information related to the objects taken by the cameras. The photos of the objects are sent to servers to analyze the photos, and their recognition results are sent back to the mobile terminals. The recognition results allow users to get information for the objects from the servers or to control the objects by selecting appropriate controllers. An electronic encyclopedia system for animals, for which a prototype system was built, and short-cut functionality to set up a television remote controller on mobile terminals are introduced.