IEEJ Transactions on Industry Applications
Online ISSN : 1348-8163
Print ISSN : 0913-6339
ISSN-L : 0913-6339
Determining Optimal Number of Hidden Units for Multi-Layered Neural Networks
Masahiro KayamaShigeo AbeHiroshi TakenagaYasuo Morooka
Author information

1992 Volume 112 Issue 11 Pages 1064-1070


Multi-layered neural networks have been widely applied to control and recognition systems. However, since there is no deterministic method to obtain an optimal number of hidden units, trial and error simulation is required to develop these systems, which is very time consuming. In this paper, a statistical algorithm based on linear regression analysis is proposed to determine the optimal number of hidden units. The optimal number defined here is the smallest one which is sufficient for the maximum generalization capability of the network. By using a trained network with enough number of hidden units, the developed method calculates the amount of linear correlation between their outputs and estimates the redundant number of hidden units corresponding to it. Finally by subtracting the redundant number from the initial one, the optimal number of hidden units can be obtained.
The developed method is applied to two typical neural network systems, i.e. a classification system (number recognition) and a non-linear approximation system (coagulant injection operation in a water purification plant), and demonstrated to be effective to estimate the optimal number of hidden units.

Information related to the author
© The Institute of Electrical Engineers of Japan
Previous article Next article