• Title/Summary/Keyword: Ant-Q

Search Result 6, Processing Time 0.02 seconds

Solving the Gale-Shapley Problem by Ant-Q learning (Ant-Q 학습을 이용한 Gale-Shapley 문제 해결에 관한 연구)

  • Kim, Hyun;Chung, Tae-Choong
    • The KIPS Transactions:PartB
    • /
    • v.18B no.3
    • /
    • pp.165-172
    • /
    • 2011
  • In this paper, we propose Ant-Q learning Algorithm[1], which uses the habits of biological ants, to find a new way to solve Stable Marriage Problem(SMP)[3] presented by Gale-Shapley[2]. The issue of SMP is to find optimum matching for a stable marriage based on their preference lists (PL). The problem of Gale-Shapley algorithm is to get a stable matching for only male (or female). We propose other way to satisfy various requirements for SMP. ACS(Ant colony system) is an swarm intelligence method to find optimal solution by using phermone of ants. We try to improve ACS technique by adding Q learning[9] concept. This Ant-Q method can solve SMP problem for various requirements. The experiment results shows the proposed method is good for the problem.

A Reinforcement Loaming Method using TD-Error in Ant Colony System (개미 집단 시스템에서 TD-오류를 이용한 강화학습 기법)

  • Lee, Seung-Gwan;Chung, Tae-Choong
    • The KIPS Transactions:PartB
    • /
    • v.11B no.1
    • /
    • pp.77-82
    • /
    • 2004
  • Reinforcement learning takes reward about selecting action when agent chooses some action and did state transition in Present state. this can be the important subject in reinforcement learning as temporal-credit assignment problems. In this paper, by new meta heuristic method to solve hard combinational optimization problem, examine Ant-Q learning method that is proposed to solve Traveling Salesman Problem (TSP) to approach that is based for population that use positive feedback as well as greedy search. And, suggest Ant-TD reinforcement learning method that apply state transition through diversification strategy to this method and TD-error. We can show through experiments that the reinforcement learning method proposed in this Paper can find out an optimal solution faster than other reinforcement learning method like ACS and Ant-Q learning.

Multi Colony Intensification.Diversification Interaction Ant Reinforcement Learning Using Temporal Difference Learning (Temporal Difference 학습을 이용한 다중 집단 강화.다양화 상호작용 개미 강화학습)

  • Lee Seung-Gwan
    • The Journal of the Korea Contents Association
    • /
    • v.5 no.5
    • /
    • pp.1-9
    • /
    • 2005
  • In this paper, we suggest multi colony interaction ant reinforcement learning model. This method is a hybrid of multi colony interaction by elite strategy and reinforcement teaming applying Temporal Difference(TD) learning to Ant-Q loaming. Proposed model is consisted of some independent AS colonies, and interaction achieves search according to elite strategy(Intensification, Diversification strategy) between the colonies. Intensification strategy enables to select of good path to use heuristic information of other agent colony. This makes to select the high frequency of the visit of a edge by agents through positive interaction of between the colonies. Diversification strategy makes to escape selection of the high frequency of the visit of a edge by agents achieve negative interaction by search information of other agent colony. Through this strategies, we could know that proposed reinforcement loaming method converges faster to optimal solution than original ACS and Ant-Q.

  • PDF

The Application of Direction Vector Function for Multi Agents Strategy and The Route Recommendation System Research in A Dynamic Environment (멀티에이전트 전략을 위한 방향벡터 함수 활용과 동적 환경에 적응하는 경로 추천시스템에 관한 연구)

  • Kim, Hyun;Chung, Tae-Choong
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.48 no.2
    • /
    • pp.78-85
    • /
    • 2011
  • In this paper, a research on multi-agent is carried out in order to develop a system that can provide drivers with real-time route recommendation by reflecting Dynamic Environment Information which acts as an agent in charge of Driver's trait, road condition and Route recommendation system. DEI is equivalent to number of n multi-agent and is an environment variable which is used in route recommendation system with optimal routes for drivers. Route recommendation system which reflects DEI can be considered as a new field of topic in multi-agent research. The representative research of Multi-agent, the Prey Pursuit Problem, was used to generate a fresh solution. In this thesis paper, you will be able to find the effort of indulging the lack of Prey Pursuit Problem,, which ignored practicality. Compared to the experiment, it was provided a real practical experiment applying the algorithm, the new Ant-Q method, plus a comparison between the strategies of the established direction vector was put into effect. Together with these methods, the increase of the efficiency was able to be proved.

Effects of Chito-oligosaccharide Supplementation on Egg Production, Nutrient Digestibility, Egg Quality and Blood Profiles in Laying Hens

  • Meng, Q.W.;Yan, L.;Ao, X.;Jang, H.D.;Cho, J.H.;Kim, I.H.
    • Asian-Australasian Journal of Animal Sciences
    • /
    • v.23 no.11
    • /
    • pp.1476-1481
    • /
    • 2010
  • This study was conducted to evaluate the effects of dietary supplementation with chito-oligosccharide (COS) on egg production, nutrient digestibility, egg quality and blood profiles in laying hens. A total of 240 Hy-line Brown laying hens were randomly allocated into one of the following 5 dietary treatments: i) CON, basal diet; ii) ANT, basal diet+44 mg/kg avilamycin; iii) COS0.2, basal diet+200 mg/kg COS; iv) COS0.4, basal diet+400 mg/kg COS; v) ANTCOS, basal diet+200 mg/kg COS+22 mg/kg avilamycin. The experiment lasted for 6 wk. No change in egg weight (p>0.05) was observed during the trial period. Egg production in ANTCOS treatment was improved (p<0.05) when compared to CON during weeks 4-6. The birds in the COS0.2, COS0.4 and ANTCOS groups had higher (p<0.05) Haugh unit than those fed CON and ANT diets at the end of the $6^{th}$ wk. The apparent digestibility of nitrogen in CON group was lower (p<0.05) than in other treatments. The white blood cell (WBC) concentration of birds in the COS0.4 and ANTCOS group was higher (p<0.05) than that of birds in other groups at the end of the $6^{th}$ wk. In addition, the differences of WBC counts between the beginning and end of the experiment in COS0.4 and ANTCOS groups were higher (p<0.05) than in CON and ANT groups. At the end of the experiment, the birds fed ANTCOS diet showed higher (p<0.05) total blood protein concentration than those fed CON or ANT diets. In conclusion, dietary supplementation of COS appeared to increase egg production and quality by increasing nutrient digestibility. Additionally, COS improved WBC and total protein concentration.

Antioxidant and Anti-inflammatory Activities of Water-soluble Extracts from Different Parts of Kojongsi Persimmon (Diospyros kaki L.) (고종시 감나무 부위별 수용성 추출물의 항산화 및 항염 활성)

  • Jeon, In Hwa;Kang, Hyun Ju;Lee, Hyun-Seo;Shin, Jun Ho;Park, Yong Gyoun;Jeong, Seung-Il;Jang, Seon Il
    • Korean Journal of Food Science and Technology
    • /
    • v.46 no.4
    • /
    • pp.505-510
    • /
    • 2014
  • Kojongsi persimmon (Diospyros kaki L.) is the major cultivar of dried persimmon in Korea. The purpose of this study was to investigate the antioxidant and anti-inflammatory activities of water-soluble extracts from the calyx (PCE), peel (PPE) and leaf (PLE) of Kojongsi persimmon. PCE showed the highest total phenolic and flavonoid contents. In addition, the antioxidant activities (diphenylpicrylhydrazyl, 2,2'-azino-bis(3-ethylbenzthiazoline-6-sulfonic acid), nitric oxide and reducing power) of PCE were higher than those of PPE and PLE. Moreover, PCE, PPE and PLE significantly suppressed the production of inflammatory mediators (nitric oxide and $prostaglandinE_2$) and pro-inflammatory cytokines (tumor necrosis factor-${\alpha}$ and interluekin-$1{\beta}$) by lipopolysaccharide-stimulated RAW 264.7 cells in a dose-dependent manner. PCE showed the highest anti-inflammatory activity. Thus, these results suggest that the calyx of Kojongsi persimmon may be highly valuable as a natural product owing to its high-quality functional components as well as its-antioxidant, ant-iinflammatory activities.