Abstract
Part 4. Rate of information transmission through a noisy channel and other related concepts are formulated as an extension of Shannonian information theory introduced in Part 3. Ergodicity of stochastic process and Gaussian probability distribution are also explained. Auto- and Cross-correlation functions and convolution integral are introduced with their Fourier transforms for elimination of effect of noise in system identification.