Development of consumer electronics devices operation system based on mouth of open/close motions

Abstract

It can be considered that mouth is available for the operation of the equipment due to the fact that its motion is very fast compared with other body parts. This paper describes a new method of communication aid with mouth open/close motions in speaking something words. The user’s face was observed by the USB camera and the mouth open/close motions were applied for the operation of the equipment such as a reclining bed, air conditioner, and so on. Here, we utilized the area of the user’s mouth approximated by Bezier curve and aspect rate in real time. We could operate the equipment intuitively by using the matching result of acquired characteristics. The equipment could be controlled via a Bluetooth communication module. In the test trial, it could be confirmed that the developed system could recognize the user’s intention, and the subjects were able to operate the reclining bed with non-contact.