Abstract
In conventional genetic programming (GP) schemes, it has not been attempted to design an autonomous agent with internal states, which makes difficult to apply those schemes to non-Markovian tasks where the sensory inputs are ambiguous. We have proposed a GP scheme that evolves an autonomous agent with internal states needed to appropriately perform non-Markovian tasks. The potentials and limitations of the proposed scheme are discussed through its application to several non-Markovian tasks.