Attention-based models combine brain and artificial-general-intelligence for industrial applications

Abstract

Recently Attention-based neural network is successfully applied to various tasks such as machine translation, caption generated from the image, the caption generation from video, speech recognition, generation of image from the caption. But those models are lacking in versatility. In this paper, we review the various attention-based neural models, and propose a generalized model of attention-based neural models using the knowledge of the brain and artificial general intelligence.