主催: Japan Society of Kansei Engineering
会議名: The 8th International Symposium on Affective Science and Engineering
回次: 8
開催地: Online Academic Symposium
開催日: 2022/03/27
These years, computer vision technology has been rapidly advanced. On the other hand, customer satisfaction is essential for the industry to improve its service but use traditional methods ineffectively. Using technology such as computer vision, we can now collect the information we are looking for directly from a human. Humans can use many kinds of modalities to interact with computers. Hands are perhaps the largest source of body language information after the face. To understand the gesture's meaning, we can use MediaPipe Hands developed at Google LLC as a method to track and recognize human hands. However, if we want to understand some kinds of hand gestures using MediaPipe Hands, we need to create a condition ourselves by using if-else conditions. This research tried to collect the many varieties of each hand gesture using the 21 key points in x, y, and z coordinates as a feature. As classifiers, we chose the support vector machine (SVM) and the artificial neural network (ANN). This research found that SVM using a polynomial kernel is the best among all of the methods we used as a classifier method for the 3D value of 21 key points from the hand skeleton. The accuracy and F1-score from SVM using a polynomial kernel were 86.26% accuracy and 82% F1-score, respectively, representing the best performance for each class of all the methods we used in this research.