NHK Science & Technology Research Laboratories is promoting research of the SUPER Hi-VISION and 3D television as next generation broadcast media. NHK Engineering Services Inc. wants to apply the technologies of the SUPER Hi-VISION to the fields such as medical, culture, and industry for returning results of research of NHK to the society widely. In this paper, some examples of applications we have developed are introduced and technical requirements required in order to apply the ultra-high resolution image to such fields are discussed.
This paper describes the authors' activities on design and evaluation of realism from following two viewpoints; (1) Design of realism based on complementation of experience. (2) Evaluation of realism based on representation of binocular disparity.
We implemented Substitutional Reality (SR) System in which experimenters could make naive participants believe a pre-recorded scene as a live scene physically happening in front of them. We discuss the manipulation of reality by SR system, as well as the contingent change in feeling of presence.
The display technologies to create realistic sensation by generating stimuli corresponding to each sensory organ as measured from target to duplicate have been studied over a long period. And main approach for creating high-realistic experience is a "multi-modal" technique which combines these technologies. This is because perception is traditionally regarded as an independent modular function. On the other hand, recent studies in cognitive science are suggesting that cross-modal interactions have an important role in our perception. In cross-modal interactions, the perception of a sensation through one sense is changed by other stimuli that are simultaneously received through other senses. Indeed, some studies have shown that the possibility of "cross-modal" approaches for presenting ultra-realistic experience. In this paper, we introduce some examples of displays using cross-modal interactions.
Recent advancement of information and communication technologies has evoked expectations for more natural and realistic communications. In studies on multimedia/multimodal communications, the enhancement of a sense of presence has been the most important issue. Although sense of presence have been intensively investigated over twenty years, it is little known yet. In this article, we first discuss the essence of sense of presence based on our recent survey of more than 200 non-researchers. Next, we show spatio-temporal characteristics for verisimilitude (vraisemblance), which is the reality or virtuality assumed to link essentially to foreground components in a scene, while contrasting it with the sense of presence, which, theoretically and empirically, has been found to relate dominantly to background components contained in a scene. Lastly we discuss future directions of measurements for higher order states of sensation such as sense of presence and verisimilitude, and its possible contributions to human-machine interfaces, communications, and entertainment technologies.
Ultra-Realistic Communication that provides natural and real communication to everybody can be achieved by means of reproducing information of 3D video and audio, touch and smell. The technologies regarding the ultra-realistic communication have made steady progress. National Institute of Information and Communications Technology, NICT, is researching ultra-realistic communication systems such as electronic holography, large screen 3D display without special glasses and multisensory interaction system. Ultra-realistic Communication Forum, URCF, supported by NICT, has been actively working for progress of related technologies for five years, and recently was reorganized. In this symposium, I will introduce researches at NICT and activities of URCF.