An attempt of a video image based game controller as an individuality respecting human interface device

Abstract

The functionality of the human limb, hand, palm, and finger should depend on the person. This should be notable in physically handicapped, but this also should be in non-disabled persons. We also call this functionality difference as personality. In this study, an individuality-respecting human interface device has been attempted to be developed. For this, shapes such as circles and rectangles drawn on paper and the finger on that paper were taken as a video by a digital camera. Then, obtained relative relationship of those positions has determined game controller input by using YOLO (You Look Only Onse) algorithm and also MediaPipe. With a developed system, a video game can be played.