Development of a Learning Environment for Sketching Human Body with Pose Change Using 3D Pose Estimation by Depth Camera

Abstract

The human sketching learning support system is a system that compares an artwork by a learner with a virtual humanoid model in regard to a skeleton or an outline and presents the difference between them and scores. In the previous study, we used a drawing doll as a tangible interface to change the posture of a virtual humanoid model. Specifically, the posture of the drawing doll was acquired by OpenPose, and depth estimation was performed by Machine Learning to estimate the three-dimensional posture. This research proposed a method to change the pose of a virtual humanoid model by 3D pose estimation of a real human using motion capture with a depth camera, and developed a system based on this method. In the evaluation experiment, we tested the usefulness of this system by using the improvement values of the scores of the experimental and control groups before and after learning.