Extraction of latent structure of motion and language through transfer learning of language knowledge

Abstract

We introduce the latent structure of human whole body motion and language through neural network. A word is represented as a numeric vector based on large scale corpus of action description. We design the latent structure of motion and natural language. This latent structure makes it possible to recognize motions as linguistic descriptions.