非言語情報に基づく受話者推定機構を用いた多人数会話システム

抄録

In order to build a conversational agent that can control multiparty conversations with multiple users, the system is required to be able to identify who is the addressee for the current floor and control the floor based on the addressee hood information. This study proposes an addressee estimation mechanism that can estimate the addressee based on speech and head direction information. Then, we implement an autonomous multiparty conversational agent by incorporating the addressee estimation mechanism into a multiparty conversation system consisting of ASR, language understanding, conversation management, and generation mechanism. The results of our system evaluation experiment show that F-measure for judgement of addrsssing to the agent was 0.8 and to the partner was 0.56, confirming that the proposed multiparty conversational agent successfully controls the conversations with users.