Transactions of the Japanese Society for Artificial Intelligence
Online ISSN : 1346-8030
Print ISSN : 1346-0714
ISSN-L : 1346-0714
Original Paper
Cognitive Validity of a Causal Value Function with Loose Symmetry and Its Effectiveness for N-armed Bandit Problems
Kuratomo OyoManabu IchinoTatsuji Takahashi
Author information
JOURNAL FREE ACCESS

2015 Volume 30 Issue 2 Pages 403-416

Details
Abstract

Cognitive psychology and behavioral economics have shown that humans have cognitive biases that deviate from normative systems such as classical logic and probability theory. Considering that humans have the ability to understand the world from sparse and/or imprecise data, it is natural to assume that the biases in human have some ecological merits in adaptation. We focus on two cognitive biases, symmetry and mutual exclusivity, that are considered peculiar to human. In this study, with the framework of empirical Bayes, we clarify the implication of a model of human causal cognition, the loosely symmetric (LS) model [Shinohara 07]) that implements the cognitive biases. We show that LS has great descriptive validity in inductive inference of causal relationship (causal induction) with a meta-analysis and an experiment in causal induction. The result of another experiment strongly suggests that humans use the inductively inferred causal relationship to decision-making. Then we show that LS effectively works in sequential decision-making under uncertainty (N-armed bandit problems). Operating LS as a simple value function under the greedy method in the framework of reinforcement learning, we analyze its behavior in terms of cognitive biases or heuristics under uncertainty. The three cognitive properties resulting from the loose symmetry, comparative valuation, satisficing, and prospect theory-like risk attitudes, are shown to be the key of the performance of LS. We parameterize the reference for satisficing and show that the quite intuitive parameter enables optimization.

Content from these authors
© The Japanese Society for Artificial Intelligence 2015
Next article
feedback
Top