Journal of Advanced Computational Intelligence and Intelligent Informatics
Online ISSN : 1883-8014
Print ISSN : 1343-0130
ISSN-L : 1883-8014
Regular Papers
Analog Value Associative Memory Using Restricted Boltzmann Machine
Yuichiro TsutsuiMasafumi Hagiwara
ジャーナル 認証あり

2019 年 23 巻 1 号 p. 60-66


In this paper, we propose an analog value associative memory using Restricted Boltzmann Machine (AVAM). Research on treating knowledge is becoming more and more important such as in natural language processing and computer vision fields. Associative memory plays an important role to store knowledge. First, we obtain distributed representation of words with analog values using word2vec. Then the obtained distributed representation is learned in the proposed AVAM. In the evaluation experiments, we found simple but very important phenomenon in word2vec method: almost all of the values in the generated vectors are small values. By applying traditional normalization method for each word vector, the performance of the proposed AVAM is largely improved. Detailed experimental evaluations are carried out to show superior performance of the proposed AVAM.



© 2019 Fuji Technology Press Ltd.
前の記事 次の記事