We propose a technique for automatically editing personal videos using video and sensor information obtained from the camera. In this study, we used personal videos cut-edited by individual users and their editing history to analyze tendencies in cut scenes (used scenes) and cut-edit points. This analysis revealed that the amount of camerawork is high in used scenes. Based on these findings, the proposed technique uses continuous rank-increase measure (CRIM) and motion correlation (MC) values calculated from space-time patches (ST-patches), which capture change in motion, and acceleration and angular speed obtained from camera sensors to select scenes in which there is a lot of camerawork and subject movement. Editing video in this way based on the user's editing tendencies promotes video editing in accordance with the user's preferences. Experimental results show that automatic video editing by the proposed technique achieves a higher degree of viewer satisfaction than a video editing technique based only on ST-patch features.

View full abstract

We propose a novel full-parallax 3D display system, called RePro3D, that is suitable for interactive 3D applications. The approach is based on retro-reflective projection technology in which several images from a projector array are displayed on a retro-reflective screen. When viewers look at the screen through a half mirror, they see a 3D image superimposed on the real scene without having to wear glasses. RePro3D has a sensor function to recognize user input, so it can support some interactive features, such as manipulation of 3D objects. In this paper, we describe the optical system of the high-density projector array. Then, we develop a prototype of RePro3D. The prototype shows parallax images that were displayed on a real scene from 42 different viewpoints. The user can touch the 3D image with his/her hands.

View full abstract

Seam carving (SC) is an image processing operator for content-aware image resizing, which enables users to shrink or enlarge pictures, while still retaining details of salient objects in the image. However, there is a problem that SC often generates obvious distortions on straight lines in the image. In this paper, we propose “proportional-lines” that are line objects for decreasing the distortion. They are arranged on straight lines in an original image to reduce distortion in a result image by two ways: (1) Proportional lines monitor distribution of seams by counting the number of seams passing through them and they dynamically arrange additional energy in a selection of a new seam to avoid over-concentration of seams. (2) They also apply image warping around them in order to reduce the number of small distortions.

View full abstract

In this paper, we apply inter-destination (or group) synchronization control, which adjusts the output timing of media among multiple terminals, to chorus with voice and video among multi-points to synchronize singing voices for the listener. By quality of experience (QoE) assessment, we show that the inter-destination synchronization control can maintain the media synchronization quality in chorus to a greater degree than when the control is not used.

View full abstract

When measuring delay profile in digital terrestrial television broadcasting, errors of delay wave level occur when the delay time is not an integer of the sampling interval. Therefore, we created theoretical formulae expressing these errors and developed an apparatus with higher level accuracy with the compensation method.

View full abstract