A Generation Method of Avatar’s Facial Expressions with “Manpu (Comic Symbols)” by Emotion Recognition

Abstract

Recently，avatar systems have been developed that link human face motions taken by cameras to CG characters’ expression. One of the conventional systems can express CG character’s expression with “manpu” (comic symbols). The manpu makes it possible to express emotional exaggeration of CG characters, however, key board operations to add manpu to the characters prevent seamless communications. If user's facial expression is directly reflected on the avatar’s, sometimes it will be an unnatural one. In this report, we proposed a generation method of avatar’s natural facial expression from user’s photos with manpu, which enables more seamless communications.