Construction and evaluation of a human-in-the-loop video annotation system for nodding during meetings

Abstract

Annotation is one of the time consuming manipulation for human to do. In our previous work, we made a nodding recognition model using annotated video data made by an annotator. We find that consumption of annotation time and the work load require for the annotator is huge. In this work we come up with the idea of human-in-the-loop video annotation system, which the machine leaning model create annotation result before the annotator finalize the annotation result.With this system we evaluated how average time consumed in annotation is reduced.