This paper presents a novel shape descriptor for topology-based segmentation of 3D video sequences. 3D video is a series of 3D meshes without temporal correspondences which benefit for applications including compression, motion analysis, and kinematic editing. In 3D video, both 3D mesh connectivities and the global surface topology can change frame by frame. This characteristic prevents from making accurate temporal correspondences through the entire 3D mesh series. To overcome this difficulty, we propose a two-step strategy which decomposes the entire sequence into a series of topologically coherent segments using our new shape descriptor, and then estimates temporal correspondences on a per-segment basis. As the result of acquiring temporal correspondences, we could extract rigid parts from the preprocessed 3D video segments to establish partial kinematic structures, and could integrate them into a single unified kinematic model which describes the entire kinematic motion in the 3D video sequence. We demonstrate the robustness and accuracy of the shape descriptor on real data which consist of large non-rigid motion and reconstruction errors.
2016 by the Information Processing Society of Japan