反射型光センサを用いた眼鏡型ウェアラブルデバイスによる顔表情パフォーマンスキャプチャ

抄録

Facial performance capture is used for animation production that projects a performer's facial expression to a computer graphics model. Retro-reflective markers and cameras are widely used for the performance capture. To capture expressions, we need to place the markers on the performer's face and calibrate the intrinsic and extrinsic parameters of the cameras in advance. However, the tracmeasurable space is limited to the calibrated area. In this paper, we propose a system to capture facial performance using a smart eyewear with photo reflective sensors and machine learning technique.