Selfie System Using Omnidirectional Camera Considering Facial Expression

Abstract

This paper proposes a selfie system using an omnidirectional camera considering facial expressions. In the proposed system, a user captures a few seconds of video with an omnidirectional camera. Next, face detection is performed on all the captured omnidirectional frames, and false face detections are eliminated and undetected faces are complemented considering consistency across all frames. Next, facial expression recognition is performed on the faces in all the frames, and the frame in which a particular facial expression is most apparent is extracted. Finally, a perspective projection image is generated from the omnidirectional image such that all the target participants are within the angle of view. Experiments demonstrate the effectiveness of the proposed method using a variety of scenes, and a developed prototype system shows the practical feasibility of the proposed system.