Multi-Layer Neural Networks

Multi-layer, feedforward networks generalize 1-layer networks (i.e., Perceptrons) to n-layer networks as follows:

  • 3-layer feedforward neural nets (i.e., nets with two hidden layers) with an LTU at each hidden and output layer unit, can compute arbitrary functions (hence they are universal computing devices) although the complexity of the function is limited by the number of units in the network.