Optimal Learning Rates in Gradient Descent Training of Multilayer Perceptrons

다층퍼셉트론의 강하 학습을 위한 최적 학습률

  • 오상훈 (목원대학교 정보통신전파공학부)
  • Published : 2004.09.01

Abstract

This paper proposes optimal learning rates in the gradient descent training of multilayer perceptrons, which are a separate learning rate for weights associated with each neuron and a separate one for assigning virtual hidden targets associated with each training pattern Effectiveness of the proposed error function was demonstrated for a handwritten digit recognition and an isolated-word recognition tasks and very fast learning convergence was obtained.

Keywords

Gradient Descent;Optimal Learning Rates