To tracking of the movement of each specific facial area caused by the facial expression using video, it is thought required to compare a neutral face with an expressive face. From this point of view, we propose a facial expressions recognition system which is performed by iritegrative judgment of each movement of a specific facial area based on automatic detected neutral face. In this system, the recognition is performed by using not usual expert system, but the expert system in which the order of application of the rule set is set based on the characteristics of the expressions.