The PSFC is a DSP-driven hemispherical loudspeaker array, installed at the University of Aizu Multimedia Center. It features realtime manipulation of the primary components of sound spatialization for each of two audio sources located in a virtual environment, including both the content (source location: apparent direction and distance) and context (room characteristics: room size and liveness). In an alternate mode, it can also direct the destination of the two separate input signals across 14 loudspeakers, manipulating the apparent direction of the virtual sound sources with no control over apparent distance other than that afforded by source loudness (i.e., no simulated environmental reflections or reverberation). The PSFC speaker dome is about 10m in diameter, accommodating about fifty simultaneous users, including about twenty users comfortably standing or sitting near its "sweet spot," the area in which the illusions of sound spatialization are most vivid. Collocated with a large screen rear-projection stereographic display, the PSFC is intended for advanced multimedia and virtual reality applications.
Virtual lesson is a concept that we construct an environment in which a teacher's skill can be recorded and a student can feel the existence of him and can learn his skill through a haptic display device. We made a virtual calligraphy system as one of its applications. In this system, what a student can learn is a teacher's horizontal brush position and his normal force of press against virtual paper and distance between a teacher's brush and virtual paper. Since it is impossible to display the normal force and normal position at the same time, we used two media, the haptic disply and a visual monitor, to display these two elements. Some preliminary experimental results are also presented.
We analyzed electroencephalograms (EEG) applying the maximum entropy method (MEM) to estimate the physiological effects of the perception of sound reality on the human brain. When we presented sound containing non-stationary, high frequency components (HFC) above the audible range, which the listeners perceived to be very real, the alpha frequency band of the listeners' EEG showed a specific transitional pattern. This pattern was not present when we presented sound from which HFC were eliminated or sound in which HFC were replaced with artificially composed, stationary HFC.