A Remote Rehabilitation and Evaluation System Based on Azure Kinect

Abstract

In response to the shortage, uneven distribution, and high cost of rehabilitation resources in the context of the COVID-19 pandemic, we developed a low-cost, easy-to-use remote rehabilitation system that allows patients to perform rehabilitation training and receive real-time guidance from doctors at home. The proposed system uses Azure Kinect to capture motions with an error of just 3% compared to professional motion capture systems. In addition, the system provides an automatic evaluation function of rehabilitation training, including evaluation of motion angles and trajectories. After acquiring the user’s 3D motions, the system synchronizes the 3D motions to the virtual human body model in Unity with an average error of less than 1%, which gives the user a more intuitive and interactive experience. After a series of evaluation experiments, we verified the usability, convenience, and high accuracy of the system, finally concluding that the system can be used in practical rehabilitation applications.