The Development of Two-Person Janggi Board Game Using Backpropagation Neural Network and Reinforcement Learning

역전파 신경회로망과 강화학습을 이용한 2인용 장기보드게임 개발

  • Park, In-Kue (Division of Information Engineering, Dept. of Computer Science) ;
  • Jung, Kwang-Ho (Division of Information Engineering, Dept. of Computer Science)
  • 박인규 (중부대학교 정보공학부 전자계산학과) ;
  • 정광호 (중부대학교 정보공학부 전자계산학과)
  • Published : 2001.11.30

Abstract

This paper describes a program which learns good strategies for two-poison, deterministic, zero-sum board games of perfect information. The program learns by simply playing the game against either a human or computer opponent. The results of the program's teaming of a lot of games are reported. The program consists of search kernel and a move generator module. Only the move generator is modified to reflect the rules of the game to be played. The kernel uses a temporal difference procedure combined with a backpropagation neural network to team good evaluation functions for the game being played. Central to the performance of the program is the search procedure. This is a the capture tree search used in most successful janggi playing programs. It is based on the idea of using search to correct errors in evaluations of positions. This procedure is described, analyzed, tested, and implemented in the game-teaming program. Both the test results and the performance of the program confirm the results of the analysis which indicate that search improves game playing performance for sufficiently accurate evaluation functions.

Keywords