• Title/Summary/Keyword: Cartpole System

Search Result 4, Processing Time 0.019 seconds

BOXES-based Cooperative Fuzzy Control for Cartpole System

  • Kwon, Sung-Gyu
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.7 no.1
    • /
    • pp.22-29
    • /
    • 2007
  • Two fuzzy controllers defined by 2 input variables cooperate to control a cartpole system in terms of balancing as well as centering. The cooperation is due to the BOXES scheme that selects one of the fuzzy controllers for each time step according to the content of box that is established through the critic of the control action by the fuzzy controllers. It is found that the control scheme is good at controlling the cartpole system so that the system is stabilized fast while the BOXES develops its ability to select proper fuzzy controller through experience.

Two Fuzzy Controllers Alternating for Cartpole System

  • Kwon, Sung-Gyu
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.9 no.2
    • /
    • pp.154-160
    • /
    • 2009
  • A control system composed of two fuzzy controllers is proposed to balance the pole as well as to move the cart to the center of the track of the cartpole system. The two fuzzy controllers are designed with 2 input variables respectively and their control characters are studied in order to devise a control scheme that alternates the two fuzzy controllers. It is found that the control system using the scheme works well even though there is some residual oscillations of the pole and the cart.

A Cooperative Fuzzy and CMAC Control for Cartpole System (CMAC에 의한 협동 퍼지 제어계의 운반차-막대 시스템 제어)

  • Kwon Sung-Gyu
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.16 no.3
    • /
    • pp.349-356
    • /
    • 2006
  • A cartpole system is controlled by a control system consisting of two fuzzy controllers cooperating by a CMAC. Each controller uses 2 different input variables and yields the control force provided to the CMAC. The cooperation is due to training of the CMAC supervised by a judge which selects training information for the CMAC between two fuzzy controllers. The control scheme could be appreciated in terms of the tight structure of the controller, simple cooperating scheme due to the CMAC training, and accomplishing control goal that could not be attained by individual controllers.

A Reinforcement Learning with CMAC

  • Kwon, Sung-Gyu
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.6 no.4
    • /
    • pp.271-276
    • /
    • 2006
  • To implement a generalization of value functions in Adaptive Search Element (ASE)-reinforcement learning, CMAC (Cerebellar Model Articulation Controller) is integrated into ASE controller. ASE-reinforcement learning scheme is briefly studied to discuss how CMAC is integrated into ASE controller. Neighbourhood Sequential Training for CMAC is utilized to establish the look-up table and to produce discrete control outputs. In computer simulation, an ASE controller and a couple of ASE-CMAC neural network are trained to balance the inverted pendulum on a cart. The number of trials until the controllers are established and the learning performance of the controllers are evaluated to find that generalization ability of the CMAC improves the speed of the ASE-reinforcement learning enough to realize the cartpole control system.