Abstract
Automatic detection and description of events, particularly human behavior, is one of the most challenging issues since the event interpretation is highly dependent on the target of attention which is not specified uniquely. In order to tackle this problem, we propose the concept of "cognitive ontology" as a framework of automatic decision of attention focus and event description system. The cognitive ontology is structured with conceptual units which are entity and relation, and those units enable robot endogenous attention fixation and jump based on networked Cognitive Ontology. Additionally, we introduce exogenous attention based on the difference from a predicted pattern of the observed targets. In this process, the corresponding target of attention is updated and set to event description buffers which is consist of two entities and one relation. In this paper, we developed and experimented this holistic event interpretation process according to endogenous attention, exogenous attention and determined event description.