Treatment of Luminance/Chrominance and Motion Information Applied to 3-D Model-based Coding of Moving Facial Images

Abstract

In model-based coding of moving facial images, a 3-D-shape model of a head is prepared on both the transmitting and the receiving sides. The coding process is carried out by transmitting shape change and motion information for this shape model. “Luminance/chrominance” and “motion” information is two kinds of basic information treated in this coding method. This paper describes useful methods to represent “luminance/chrominance” and “motion” information so that it can be treated without restrictions on a specific shape model or input images. For “luminance/chrominance” information in each triangle composing the 3-D-shape model, the value is represented by 153 triangular lattice points. For “motion”, the detected shape change of each object is represented by object-dependent parameters and motion parameters. Experimental results show the effectiveness of the proposed methods.