2020 Volume 25 Issue 2 Pages 158-168
Observing rapid movements, such as the key moments needed to correctly judge fouls in sports, is a challenging task for referees. Though assistive technology like 2D slow-motion replays exist, users are still limited by the viewing angle and degree of interaction with these videos.
In this paper, we propose an interactive 3D vision augmentation framework called MomentViz that allows for both high frame rate recording and interactive time-control in 3D space. This system is designed to allow users not only to freely observe dynamic 3D motion from different viewpoints but also to control time from any given viewpoint. To accomplish this, we start by fusing high FPS RGB and depth data to carry out 3D reconstruction. Through a VR HMD, time can then be manipulated in a user selected sub-region of interest of the point cloud by raycasting with a controller. To evaluate this framework for interaction, we conducted experiments testing participants’ judgments of rapid movements. Results showed that MomentViz outperforms conventional visualizations in terms of accuracy, required views, and subjective user experience.
