The physical conditions for superimposing characters on a TV screen, such as the number of characters and the length of display time, must be flexible in accordance with the program and the audience. The NHK public television teletext service for the hearing impaired started last year displays summarized wording of sentences in accordance with screen space limitations and other technical restrictions. Since complete speech and narrative captions do not restrict information output, they can reflect more accurately the meaning of the original program and match captions with lip movement. This method is thus more appropriate for the post-lingually deafened. There are also great benefits in superimposing captions automatically. To more fully evaluate the possibilities and effects of superimposing complete speech and narrative captions, we investigated the following three areas: 1) the design and development of a new, speedy, easily-handled caption superimposing device different from the telop-card system, 2) mathematical limitations, such as character number and time length, and 3) the effects of superimposing complete speech and narrative captions. The principal results were as follows: 1. We created a new interface capable of representing word processor output using a commercially available Japanese language word processor and video equipment. We found that this method requires only one tenth the time required by the old systems. 2. Although the number of characters and length of display time vary in accordance with the type of program, such as drama, documentary, etc., the maximum number of characters per picture differs comparatively little with programs. We believe that by superimposing at a maximum rate of 4.8 characters per picture it will be possible to superimpose complete speech and narrative captions. We chose the popular serialized television drama "Oshin" as a suitable program for testing the superimposition of complete speech and narrative captions with the superimposing device which we developed. 3. We showed the drama "Oshin" to 20 deaf students studying dental technology at the school for the deaf affiliated with the University of Tsukuba. The following procedure was used: 1) Non-captioned video (the same as that broadcast for the hearing) was shown to all the students. 2) Students were divided into two groups. One was shown summarized captions; the other was shown complete speech and narrative captions. After seeing the video, the students in each group were requested to describe the events of the drama they had been shown. The results of the two groups were compared, and it was found that the comprehension of those shown the fully captioned drama exceeded that of the group shown summarized captions.
View full abstract