Detection of Visually-presented Unknown Words based on Electroencephalography

Abstract

The appearance of unknown words often disturbs communication. Most spoken dialog systems deal with unknown words that are uttered by the user, but which are not covered by the system's vocabulary. In this paper, we focus on detecting unknown words from the user side in which the system utterance is unknown to the user. In particular, we develop a classi er based on Electroencephalography (EEG) signal from user's brain waves, including the use of absolute power and Event-Related Desynchronization (ERD) features. The results show that we could detect the characteristics of brain waves at the time of unknown word perception signi cantly better than the chance rate.