IEEJ Transactions on Electronics, Information and Systems
Online ISSN : 1348-8155
Print ISSN : 0385-4221
ISSN-L : 0385-4221
A Compact Structuring Method for Hierarchical Neural Networks by Eliminating Extra Hidden Layers and Units
Tatsuya MasudaKoji SatoHirohiko IkeyaYoshiyuki Fujii
Author information
JOURNAL FREE ACCESS

1994 Volume 114 Issue 11 Pages 1194-1200

Details
Abstract
When we apply a hierarchical neural network based on the back-propagation algorithm to a particular problem, we must determine beforehand the suitable size of network for the problem. But it is a very difficult problem. Too small a network will not learn at all, while too large a network will be inefficient and worsen its generalization ability due to overfitting.
In order to solve this problem, in this paper we propose a compact structuring method based on learning with a large size network and then compacting gradually the network by eliminating extra hidden layers and units. The result is a small and efficient network that performs better than the original. Also we demonstrate the effectiveness of this method by appling it to an identification problem of logic function.
Content from these authors
© The Institute of Electrical Engineers of Japan
Previous article Next article
feedback
Top