IPSJ Transactions on Computer Vision and Applications
Online ISSN : 1882-6695
ISSN-L : 1882-6695
3D Face Reconstruction and Gaze Estimation from Multi-view Video using Symmetry Prior
Qun ShiShohei NobuharaTakashi Matsuyama
Author information

2012 Volume 4 Pages 149-160


In this paper we propose a novel method that performs 3D face reconstruction, and non-constrained and non-contact gaze estimation on a moving object, whose head-pose can freely change, from multi-view video. The main idea is to first reconstruct the 3D face with high accuracy using symmetry prior. Then we generate a super-resolution virtual frontal face video from the estimated 3D face geometry and the original multi-view video. Finally a 3D eyeball model is introduced to estimate the three-dimensional gaze direction from the virtual frontal face video. Experiments with real data illustrate the effectiveness of our method.

Content from these authors
© 2012 by the Information Processing Society of Japan
Previous article Next article