• Title/Summary/Keyword: neighboring state

Search Result 160, Processing Time 0.033 seconds

Effect by the application of the Verlet Neighboring list in a Molecular Dynamics Simulation (분자동역학법에 있어 인접분자 리스트의 영향)

  • Choi Hyun-Kue;Kim Hae-min;Choe Soon-Youl;Kim Kyung-Kun;Choi Soon-Ho
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.29 no.1
    • /
    • pp.60-67
    • /
    • 2005
  • Generally. in the molecular dynamics simulations. the Verlet neighboring list algorithm is used for the reduction of a simulation time On the other hand. the application of the Verlet neighboring list forces the time evolution of a simulation system to follow an unrealistic path in a phase space. In equilibrium state, it does not matter with the simulation results because the individual molecule's motion is originally random and any effect due to a small deviation from a real time evolution can be completely ignored. However, if an unsteady state is involved. such a deviation may significantly affect to the results. That is, there is a Possibility that the simulation results Provide ones with any misleading data In this study we evaluated the effect due to the Verlet neighboring list in performing the simulation of a non-equilibrium state and suggested the method to avoid it.

Region-based Q- learning For Autonomous Mobile Robot Navigation (자율 이동 로봇의 주행을 위한 영역 기반 Q-learning)

  • 차종환;공성학;서일홍
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.174-174
    • /
    • 2000
  • Q-learning, based on discrete state and action space, is a most widely used reinforcement Learning. However, this requires a lot of memory and much time for learning all actions of each state when it is applied to a real mobile robot navigation using continuous state and action space Region-based Q-learning is a reinforcement learning method that estimates action values of real state by using triangular-type action distribution model and relationship with its neighboring state which was defined and learned before. This paper proposes a new Region-based Q-learning which uses a reward assigned only when the agent reached the target, and get out of the Local optimal path with adjustment of random action rate. If this is applied to mobile robot navigation, less memory can be used and robot can move smoothly, and optimal solution can be learned fast. To show the validity of our method, computer simulations are illusrated.

  • PDF

Reinforcement Learning using Propagation of Goal-State-Value (목표상태 값 전파를 이용한 강화 학습)

  • Kim, Byeong-Cheon;Yun, Byeong-Ju
    • The Transactions of the Korea Information Processing Society
    • /
    • v.6 no.5
    • /
    • pp.1303-1311
    • /
    • 1999
  • In order to learn in dynamic environments, reinforcement learning algorithms like Q-learning, TD(0)-learning, TD(λ)-learning have been proposed. however, most of them have a drawback of very slow learning because the reinforcement value is given when they reach their goal state. In this thesis, we have proposed a reinforcement learning method that can approximate fast to the goal state in maze environments. The proposed reinforcement learning method is separated into global learning and local learning, and then it executes learning. Global learning is a learning that uses the replacing eligibility trace method to search the goal state. In local learning, it propagates the goal state value that has been searched through global learning to neighboring sates, and then searches goal state in neighboring states. we can show through experiments that the reinforcement learning method proposed in this thesis can find out an optimal solution faster than other reinforcement learning methods like Q-learning, TD(o)learning and TD(λ)-learning.

  • PDF

A Comparative Study on the Air Law in Korea and Neighboring Countries. (한반도 주변국가의 항공법 비교연구)

  • Oh, Sung-Kyu;Kim, Maeng-Sern
    • The Korean Journal of Air & Space Law and Policy
    • /
    • v.24 no.2
    • /
    • pp.105-137
    • /
    • 2009
  • International Civil Aviation Convention contracted in 1944 adopted International Standards and Recommended Practices(SARPs) as Annexes to Convention for safety and order of International Air Transport and each contracting State shall establish and amend the law on the basis of the SAPRs. However, Any State which find it impracticable to comply in all respects with any such SARPs, or which deems it necessary to adopt regulations or practices differing in any particular respect from those established by SARPs shall give immediate notification to the ICAO of the differences between its own practice and that established by the SARPs and ICAO publish these difference notices as a supplement to annexes. Korea and neighboring countries contracting States with International Civil Aviation Convention are accomplishing standardization of regulation on the basis of SARPs in each State. Air Law of each State need to study on the trait and differences for safety of frequent air transport services around the Korean Peninsula, However, because Korea and Neighboring countries have differences of Air Law by reason of cultural differences and circumstance of each State. Korea and Neighboring countries mean Republic of Korea, The People's Republic of China, Japan and The Domestic People's Republic of Korea and study on Air Law of each state in this study. One of purposes of this study is to analyze the history and organization of each state and then to review how establishing own air law affect air law of each state. Another purpose is to make comparative study on differences between own regulation in Korea and neighboring countries and SARPs and then to review how the differences notice of each state affect air law of each state.

  • PDF

A Study on the Maritime Baseline of the Unified Korea's Northern Part : Focused on the State-Succession (통일한국 북측해역 기선설정에 관한 쟁점연구 - 국가승계론을 중심으로)

  • Ko, Myoung-Su
    • Strategy21
    • /
    • s.38
    • /
    • pp.163-192
    • /
    • 2015
  • This study is intended for the Maritime Boundaries(Baseline) of the Unified Korea. According to the international law, North-Korea is recognized as a nation. Then with unification, the state succession will be a very important issue. Thus we should seek for the expected problems and counter-measures, by analyzing of the State-succession. There is a conflict of the positive or negative reaction about the state succession. However, in general, 'the principle of continuity' has been applied for at the national border treaty, regardless of the type of State succession. This can be found on Article 11 & 12 of the 「1978 Vienna Convention on Succession of States in Respect of Treaties」, Article 62, paragraph 2 of the 「1969 Vienna Convention on the Law of Treaties」, and a series of international case law. Currently it is being understood as customary international law. In summary, although South and North Korea, China, Russia and Japan are not the parties of 「1978 Vienna Convention」, the unified Korea will necessarily have a duty to succeed national boundaries(also, maritime baseline) of North Korea. Specifically, we have an objective and rigorous review of the treaty of maritime baseline that is signed between North Korea and neighboring countries, such as 「National Border Treaty Regime between North Korea and China」 and 「Treaty between the Union of Soviet Socialist Republics and the Democratic people's Republic of Korea on the Demarcation of the Soviet-Korea National Border」. Also, we analyzed 'Historical Bays' and 'Straight Baseline' system. By this, we are able to occupy a favorable position when renegotiating with neighboring countries, at the point of unification.

Fuzzy Q-learning using Weighted Eligibility (가중 기여도를 이용한 퍼지 Q-learning)

  • 정석일;이연정
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2000.11a
    • /
    • pp.163-167
    • /
    • 2000
  • The eligibility is used to solve the credit-assignment problem which is one of important problems in reinforcement learning. Conventional eligibilities which are accumulating eligibility and replacing eligibility make ineffective use of rewards acquired in learning process. Because only an executed action in a visited state is learned by these eligibilities. Thus, we propose a new eligibility, called the weighted eligibility with which not only an executed action but also neighboring actions in a visited state are to be learned. The fuzzy Q-learning algorithm using proposed eligibility is applied to a cart-pole balancing problem, which shows improvement of learning speed.

  • PDF

Neighboring Vehicle Maneuver Detection using IMM Algorithm for ADAS (지능형 운전보조시스템을 위한 IMM 기법을 이용한 전방차량 거동추정기법)

  • Jung, Sun-Hwi;Lee, Woon-Sung;Kang, Yeonsik
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.8
    • /
    • pp.718-724
    • /
    • 2013
  • In today's automotive industry, there exist several systems that help drivers reduce the possibility of accidents, such as the ADAS (Advanced Driver Assistance System). The ADAS helps drivers make correct and quick decisions during dangerous situations. This study analyzed the performance of the IMM (Interacting Multiple Model) method based on multiple Kalman filters using the data acquired from a driving simulator. An IMM algorithm is developed to identify the current discrete state of neighboring vehicles using the sensor data and the vehicle dynamics. In particular, the driving modes of the neighboring vehicles are classified by the cruising and maneuvering modes, and the transition between the states is modeled using a Markovian switching coefficient. The performance of the IMM algorithm is analyzed through realistic simulations where a target vehicle executes sudden lane change or acceleration maneuver.

A Study on Characteristics of the Caravanserai Space of Islam (이슬람의 카라반세라이(caravanserail)공간의 특성에 관한 연구)

  • 심복기;정낙원
    • Korean Institute of Interior Design Journal
    • /
    • v.13 no.4
    • /
    • pp.156-163
    • /
    • 2004
  • The Caravanserai, which can be discovered in the Islamic States in the regions of the Northern Africa and the Middle Asia, still maintains its profound influence to the Islamic World as one of significant edifices in the Islamic World. The majority of the Islamic people at the time of the foundation of Islamic State around AD. 7th century was the nomads, and a trade by means of caravan with their neighboring people was their critical activity for obtaining the necessities of life. With its political and social condition of the Islamic State stabilized and economy developed, the scope of commerce began to grow and the scale of trading with foreign countries started to expand. Along with this economic expansion, the caravanserai began to take a shape as a channel through which not only could the commercial commodities be traded but also religious Islamic ideas and important information could be spread into and shared with the people of neighboring countries. The significance of the caravanserai comes from such observation that it did play major roles in consolidating the solidarity of Islamic states and keeping a religious unity among them. The caravanserai, heading far beyond being a mere commercial center, ultimately functioned as a seedbed of life and spirit of the Islam. Starting from the understanding of social and political significance of the caravanserai, I set the first objective of this article to read into the architecture and interior design of the caravanserai and understand the general characteristics of the Islamic architecture and interior design.

Region-based Q-learning for intelligent robot systems (지능형 로보트 시스템을 위한 영역기반 Q-learning)

  • Kim, Jae-Hyeon;Seo, Il-Hong
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.3 no.4
    • /
    • pp.350-356
    • /
    • 1997
  • It is desirable for autonomous robot systems to possess the ability to behave in a smooth and continuous fashion when interacting with an unknown environment. Although Q-learning requires a lot of memory and time to optimize a series of actions in a continuous state space, it may not be easy to apply the method to such a real environment. In this paper, for continuous state space applications, to solve problem and a triangular type Q-value model\ulcorner This sounds very ackward. What is it you want to solve about the Q-value model. Our learning method can estimate a current Q-value by its relationship with the neighboring states and has the ability to learn its actions similar to that of Q-learning. Thus, our method can enable robots to move smoothly in a real environment. To show the validity of our method, navigation comparison with Q-learning are given and visual tracking simulation results involving an 2-DOF SCARA robot are also presented.

  • PDF

New records of flowering plants for the flora of Myanmar collected from southern Shan State

  • KANG, Dae-Hyun;KYAW, Naing Oo;JUNG, Eui-Kwon;SHIN, Jae-Seo;KIM, Young-Dong;ONG, Homervergel G.
    • Korean Journal of Plant Taxonomy
    • /
    • v.48 no.3
    • /
    • pp.218-229
    • /
    • 2018
  • Myanmar's plant diversity is expected to be very high given the wide variety of climates and the diverse vegetation and geographical features of the country. Since the publication of Kress et al.'s plant checklist in 2003, new and unrecorded species have been constantly reported by various botanists, but much of Myanmar's flora requires more intensive examinations. We conducted joint floristic surveys of several Ywangan areas, including the Panlaung-Pyadalin Cave Wildlife Sanctuary in southern Shan State of Myanmar. The initial identification of seed plant specimens collected from three short floristic expeditions revealed that 23 species were newly recorded species in Myanmar. More than half of these were found to be geographically notable species, which are known to be endemic to neighboring countries such as China (4 spp.), Thailand (6 spp.), and India (2 spp.). A considerable number of these unrecorded species are distributed in the limestone areas of neighboring countries, reflecting the geological characteristics of the survey area. The results of this study reemphasize the need for intensive and continuous research on the flora of Myanmar for a more comprehensive understanding of the distribution patterns of flowering plants in Southeast Asia.