Abstract
A prototype system for inferring TV scenes in which viewers show strong interest attempts to recognize viewers' facial expressions and combines the results with those from other modalities. An experiment demonstrated that our facial expression recognition method could recognize a certain expressive face with great accuracy.