The Power of Approximating: a Comparison of Activation Functions

Bhaskar DasGupta, Georg Schnitger

Advances in Neural Information Processing Systems 5 (NIPS 1992)

We compare activation functions in terms of the approximation power of their feedforward nets. We consider the case of analog as well as boolean input.