목표상태 값 전파를 이용한 강화 학습

Reinforcement Learning using Propagation of Goal-State-Value

  • 김병천 (명지대학교 대학원 컴퓨터공학과/정보통신교육연구센터) ;
  • 윤병주 (명지대학교 컴퓨터공학과/정보통신교육연구센터)
  • 발행 : 1999.05.01

초록

In order to learn in dynamic environments, reinforcement learning algorithms like Q-learning, TD(0)-learning, TD(λ)-learning have been proposed. however, most of them have a drawback of very slow learning because the reinforcement value is given when they reach their goal state. In this thesis, we have proposed a reinforcement learning method that can approximate fast to the goal state in maze environments. The proposed reinforcement learning method is separated into global learning and local learning, and then it executes learning. Global learning is a learning that uses the replacing eligibility trace method to search the goal state. In local learning, it propagates the goal state value that has been searched through global learning to neighboring sates, and then searches goal state in neighboring states. we can show through experiments that the reinforcement learning method proposed in this thesis can find out an optimal solution faster than other reinforcement learning methods like Q-learning, TD(o)learning and TD(λ)-learning.

키워드