Stable Dynamic Parameter Adaption

Stefan M. Rüger

Advances in Neural Information Processing Systems 8 (NIPS 1995)

A stability criterion for dynamic parameter adaptation is given. In the case of the learning rate of backpropagation, a class of stable algorithms is presented and studied, including a convergence proof.