The purpose of this research is to realize an amusement robot system to perform interactive motions by evaluating emotion of audiences at theme parks. In this paper, we proposed the robot system with the evaluation method by recognizing motion of audiences with camera images. Then, we confirmed the validity of the proposed method with experimental results.