Mouse Cursor Control System using Facial Movements

Abstract

It is necessary to support of computer operation for a physically disabled person. One of the possible physical movements of the physically disabled person is facial movement. Recognition of facial movement of a person makes it possible to operate a computer. Furthermore without the adjustment for a user and adjustment for the distance from a user, it is possible to reduce the burden on a user. We developed a system to resolve these problems. In our system, a web camera, dlib C++ library and OpenCV library are used to extract feature points of the face and obtain the face direction. Changing the face direction, we can move a mouse cursor. Recognizing an open mouth or closed eye, we can carry out an operation of mouse click. In this paper, we evaluated the effect on operability due to the face direction and recognition rate due to distance.