International Symposium on Affective Science and Engineering
Online ISSN : 2433-5428
ISASE2022
セッションID: PM-2B-5
会議情報

Cognitive Science & Artificial Intelligence
Hand Gesture Recognition by Hand Landmark Classification
Khawaritzmi Abdallah AHMADDian Christy SILPANIKaori YOSHIDA
著者情報
会議録・要旨集 フリー

詳細
抄録

These years, computer vision technology has been rapidly advanced. On the other hand, customer satisfaction is essential for the industry to improve its service but use traditional methods ineffectively. Using technology such as computer vision, we can now collect the information we are looking for directly from a human. Humans can use many kinds of modalities to interact with computers. Hands are perhaps the largest source of body language information after the face. To understand the gesture's meaning, we can use MediaPipe Hands developed at Google LLC as a method to track and recognize human hands. However, if we want to understand some kinds of hand gestures using MediaPipe Hands, we need to create a condition ourselves by using if-else conditions. This research tried to collect the many varieties of each hand gesture using the 21 key points in x, y, and z coordinates as a feature. As classifiers, we chose the support vector machine (SVM) and the artificial neural network (ANN). This research found that SVM using a polynomial kernel is the best among all of the methods we used as a classifier method for the 3D value of 21 key points from the hand skeleton. The accuracy and F1-score from SVM using a polynomial kernel were 86.26% accuracy and 82% F1-score, respectively, representing the best performance for each class of all the methods we used in this research.

著者関連情報
© 2022 Japan Society of Kansei Engineering
前の記事 次の記事
feedback
Top