Information contents will be more and more important in the progress of broadcasting and communication infrastructure and computer technologies. In this paper, some research activities in NHK are introduced regarding production systems that can effectively create high quality multimedia contents using intelligent information technologies.
We will propose a new framework of management for sports video, especially for live broadcasting. A lot of adequate indices for huge video property are required to make good use of them. We have already proposed DTPP(Desk Top Program Production), in which we can manage all information on making program with using storyboard. In this paper, we will expand this DTPP and describe some methods for making indices and structure of database for sports video. We have chosen soccer as the first step, and show how this audio-visual scorebook works in network environment.
We proposed a simple method using IIR filters to approximate head-related transfer functions (HRTFs) for realizing sound images localization, previously. However, front-rear judgement errors, the sounds that simulated the rear sound images were symmetrically localized on the interaural axis, were increased in comparison with the FIR filters. In this paper we set up some design conditions which were taken account of the specified frequency bands 500 Hz to 2 kHz and 8 kHz to 12.5 kHz, which play a important role in the rear sound localization, in the approximation process of the HRTFs. Sound localization experiments on the horizontal plane were carried out using the design conditions with 2-loudspeaker reproduction. As a result, the accuracy of rear sound localization was improved in consideration of the specified frequency bands.
In this paper, we propose a remote video monitoring system using variable resolution coding, i.e.a sort of digital zooming function, to be applied in remote caring environment. In this system a target division of a monitored scene is chosen by the operation from a remote receiving side and it is encoded and transmitted by "APC" coding (based on MPEG-4) to reproduce the divisional image in higher resolution.
We have developed the All Format Decoder (AFD), which is an MPEG-2 Video Decoder for the Digital Television using the MAP-CA media-processor based on the VLIW architecture. The down-sampling algorithm of AFD enables us to reduce the amount of necessary memory and processor power. By efficient use of SIMD instructions, the DMA engine, and the Co-Processor for variable length decoding of the MAP-CA, the AFD can decode the video stream of 1080i format with only 3.5MB memory at 270MHz of the CPU clock.
Recently, we can easily enjoy MPEG-2 application at home because of the introduction of digital TV broadcast, the wide spread of DVD video. As for home information appliances, personal computers have come into wide use, and home networking using IEEE1394, as a general-purpose interface between audiovisual appliance, has been discussed. Considering such environment, we have developed a compact MPEG-2 recording box with IEEE1394.