Automatic acoustic scene analysis of touring videos

Abstract

This research proposes a system for creating touring videos with a higher sense of realism. The system combines video taken with a 360-degree camera during a touring trip and audio recorded with a binaural recording, divides the audio into several seconds, and performs machine learning. Based on this learning result, we propose a system for labeling the recorded sound and automatically generating video.