On the trade-off between the number of nodes and the number of trees in Random Forest

Abstract

Expressibility of machine learning models has been extensively studied. For example, in a Neural Network, it is proved that the efficiency concerning the number of nodes is generated from the depth. On the other hand, it is not clear whether the efficiency exists in Random Forest. Therefore, in this research, we investigate whether the efficiency exists in Random Forest. We rst show that Random Forest does not have the same kind of efficiency as Neural Network, and next we show that the efficiency concerning the number of nodes can be generated from the number of trees.