We created an OPTO-NAVI system as a multi-purpose remote controller for home information appliances based on an augmented reality using image information. The system uses a custom CMOS image sensor with a function for detecting high-speed optical ID signals from home information appliances, which are depicted as icons on the OPTO-NAVI terminal and are superimposed on a scene image. The advantage of the system is that these home information appliances can be intuitively operated, much like window systems. A framework for software and hardware of the OPTO-NAVI system under the networking environment is described. Detection and decoding of ID signals and a method for stable icon-displaying are also described. We show an experimental system with OPTO-NAVI using Hyper-Text Transfer Protocol (HTTP) and demonstrate its basic double-click and drag-and-drop operations.
