Transactions of the Institute of Systems, Control and Information Engineers
Online ISSN : 2185-811X
Print ISSN : 1342-5668
ISSN-L : 1342-5668
Learning Algorithm of Multilayer Neural Network Using an Orthonormalization Method
Yoshihiro YAMAMOTO
Author information

1996 Volume 9 Issue 10 Pages 467-475


Recently, the author proposed a new learning algorithm derived algebraically which is composed of the error back propagation to give a fictitious teacher to each hidden layer and the update rule of each connection. The details of the algorithm with some comments are demonstrated in this paper using the Exclusive-OR problem as an example. Some update rules of each connection are also proposed here. Among them, the update rule using an orthonormalization method with some scheme is most effective. Simulation results show thst 5 steps convergence can be obtained in many cases of different initial values. The exceptional cases which do not show the convergence are also made convergent by some improvement in the nonlinear characteristic of the unit.

Information related to the author
© The Institute of Systems, Control and Information Engineers
Previous article Next article