This article surveys the history of the field of Neural Network research and presents a review of several techniques developed in the field. Attempts at statistical analysis of search dynamics of the optimization methods in Soft Computing and recent advances on implementation in parallel computers are briefly introduced.
