• Title/Summary/Keyword: Upper confidence bound

Search Result 10, Processing Time 0.028 seconds

Reinforcement learning packet scheduling using UCB (UCB를 이용한 강화학습 패킷 스케줄링)

  • Kim, Dong-Hyun;Kim, Min-Woo;Lee, Byung-Jun;Kim, Kyung-Tae;Youn, Hee-Yong
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2019.01a
    • /
    • pp.45-46
    • /
    • 2019
  • 본 논문에서는 Upper Confidence Bound (UCB)를 이용한 효율적인 패킷 스케줄링 기법을 제안한다. 기존 e-greedy 등 강화학습의 보상을 극대화 할 수 있는 행동을 선택하는 것과 다르게, 제안된 UCB를 이용한 강화학습 패킷 스케줄링 기법은 각 상태에서 행동을 선택한 횟수를 추가적으로 고려한다. 이는 보다 효율적인 강화학습의 탐구(Exploration)를 가능케 한다. 본 논문에서는 컴퓨터 시뮬레이션을 통하여 제안하는 UCB를 이용한 강화학습 패킷 스케줄링 기법이 기존의 e-greedy 및 softmax를 기반으로 한 패킷 스케줄링 기법에 비해 정확도 측면에서 향상된 정확도를 보인다.

  • PDF

Exploiting a Statistical Threshold for Efficiently Identifying Correlated Pairs

  • Kim, Myoung-Ju;Park, Hee-Chang
    • Journal of the Korean Data and Information Science Society
    • /
    • v.19 no.2
    • /
    • pp.551-558
    • /
    • 2008
  • Association rule mining searches for interesting relationships among items in a given database. Association rules are frequently used by retail stores to assist in marketing, advertising, floor placement, and inventory control. There are three primary quality measures for association rule, support and confidence and lift. If there is many item in the association rule, much time is required. Xiong(2004) studies new method which is to compute the support of upper. They used support of upper to the $^{\theta}$. But $^{\theta}$ is subjective. In this paper, we present statistical objective criterion for efficiently identifying correlated pairs.

  • PDF

Exploiting a statistical threshold for efficiently identifying correlated pairs

  • Kim, Myoung-Ju;Park, Hee-Chang
    • 한국데이터정보과학회:학술대회논문집
    • /
    • 2006.11a
    • /
    • pp.197-203
    • /
    • 2006
  • Association rule mining searches for interesting relationships among Items in a given database. Association rules are frequently used by retail stores to assist in marketing, advertising, floor placement, and inventory control. There are three primary quality measures for association rule support and confidence and lift. If there is many item in the association rule, much time is required. Xiong(2004) studies new method which is to compute the support of upper. They used support of upper to the $\theta$. But $\theta$ is subjective. In this paper, we present statistical objective criterion for efficiently identifying correlated pairs.

  • PDF

Bayesian Reliability Estimation of a New Expendable Launch Vehicle (신규 개발하는 소모성 발사체의 베이지안 신뢰도 추정)

  • Hong, Hyejin;Kim, Kyungmee O.
    • Journal of Korean Society for Quality Management
    • /
    • v.42 no.2
    • /
    • pp.199-208
    • /
    • 2014
  • Purpose: This paper explains how to obtain the Bayes estimates of the whole launch vehicle and of a vehicle stage, respectively, for a newly developed expendable launch vehicle. Methods: We determine the parameters of the beta prior distribution using the upper bound of the 60% Clopper-Pearson confidence interval of failure probability which is calculated from previous launch data considering the experience of the developer. Results: Probability that a launch vehicle developed from an inexperienced developer succeeds in the first launch is obtained by about one third, which is much smaller than that estimated from the previous research. Conclusion: The proposed approach provides a more conservative estimate than the previous noninformative prior, which is more reasonable especially for the initial reliability of a new vehicle which is developed by an inexperienced developer.

시설배치문제의 의사결정지원 시스템 - 그래프이론의 접근

  • 이호준
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 1989.10a
    • /
    • pp.77-85
    • /
    • 1989
  • The purpose of this research entails the study of the multicriteria graph-theoretic Facility Layout Problem(FLP), the development of a Decision Support System(DSS), and a sensitivity analysis for graph Theoretic heuristics. The graph theoretic FLP Decision Support System gives decision makers or planners more information as a guide in producing their final layouts. This information is provided by a variety of final result scores, so called upper bound values, based on different options and different criteria. The increased information provided will give decision makers more confidence in design a block plan. One case is presented to demonstrate the applicability of the system to real-world problem. Finally, applicabilities of the DSS to other format layouts, such as GT layout and JIT's U-line, are briefly mentioned.

  • PDF

A Statistical Methodology to Estimate the Economical Replacement Time of Water Pipes (상수관로의 경제적 교체시기를 산정하기 위한 통계적 방법론)

  • Park, Su-Wan
    • Journal of Korea Water Resources Association
    • /
    • v.42 no.6
    • /
    • pp.457-464
    • /
    • 2009
  • This paper proposes methodologies for analyzing the accuracy of the proportional hazards model in predicting consecutive break times of water mains and estimating the time interval for economical water main replacement. By using the survival functions that are based on the proportional hazards models a criterion for the prediction of the consecutive pipe breaks is determined so that the prediction errors are minimized. The criterion to predict pipe break times are determined as the survival probability of 0.70 and only the models for the third through the seventh break are analyzed to be reliable for predicting break times for the case study pipes. Subsequently, the criterion and the estimated lower and upper bound survival functions of consecutive breaks are used in predicting the lower and upper bounds of the 95% confidence interval of future break times of an example water main. Two General Pipe Break Prediction Models(GPBMs) are estimated for an example pipe using the two series of recorded and predicted lower and upper bound break times. The threshold break rate is coupled with the two GPBMs and solved for time to obtain the economical replacement time interval.

Finite Element Model Updating and System Identification of Reinforced Concrete Specimen (철근콘크리트 실험체의 시스템 식별과 유한요소모델수정)

  • Kim, Hack-Jin;Yu, Eun-Jong;Kim, Ho-Geun;Lee, Sang-Hyun;Cho, Seung-Ho;Chung, Lan
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2008.04a
    • /
    • pp.647-652
    • /
    • 2008
  • This paper focused on the application of finite element model updating technique to evaluate the structural properties of the reinforced concrete specimen using the data collected from shaking table tests. The specimen was subjected to six El Centro(NS, 1942) ground motion histories with different Peak Ground Acceleration(PGA) ranging from 0.06g to 0.50g. For model updating, flexural stiffness values of structural members(walls and slabs) were chosen as the updating parameters so that the converged results have direct physical interpretations. Initial values for finite element model were determined from the member dimensions and material properties. Frequency response functions(i.e. transfer functions), natural frequencies and mode shapes were obtained using the acceleration measurement at each floor and given ground acceleration history. The weighting factors were used to account for the relative confidence in different types of inputs for updating(i.e. transfer function and natural frequencies). The constraints based on upper/lower bound of parameters and sensitivity-based constraints were implemented to the updating procedure in this study using standard bounded variable least-squares(BVLS) method. The veracity of the updated finite element model was investigated by comparing the predicted and measured responses. The results indicated that the updated model replicates the dynamic behavior of the specimens reasonably well. At each stage of shaking, severity of damage that results from cracking of the reinforced concrete member was quantified from the updated parameters(i.e. flexural stiffness values).

  • PDF

Finite Element Model Updating and System Identification of Reinforced Concrete Specimen (철근콘크리트 실험체의 시스템 식별과 유한요소 모델 수정)

  • Kim, H.J.;Yu, E.J.;Kim, H.G.;Chang, K.K.;Lee, S.H.;Cho, S.H.;Chung, L.
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.18 no.7
    • /
    • pp.725-731
    • /
    • 2008
  • This paper focused on the application of finite element model updating technique to evaluate the structural properties of the reinforced concrete specimen using the data collected from shaking table tests. The specimen was subjected to six El Centre (NS, 1942) ground motion histories with different peak ground acceleration (PGA) ranging from 0.06 g to 0.50 g. For model updating, flexural stiffness values of structural members (walls and slabs) were chosen as the updating parameters so that the converged results have direct physical interpretations. Initial values for finite element model were determined from the member dimensions and material properties. Frequency response functions (i.e. transfer functions), natural frequencies and mode shapes were obtained using the acceleration measurement at each floor and given ground acceleration history. The weighting factors were used to account for the relative confidence in different types of Inputs for updating (j.e. transfer function and natural frequencies) The constraints based on upper/lower bound of parameters and sensitivity-based constraints were implemented to the updating procedure in this study using standard bounded variable least-squares(BVLS) method. The veracity of the updated finite element model was investigated by comparing the predicted and measured responses. The results indicated that the updated model replicates the dynamic behavior of the specimens reasonably well. At each stage of shaking, severity of damage that results from cracking of the reinforced concrete member was quantified from the updated parameters (i.e. flexural stiffness values).

An Interval Travel Demand Estimation Method (구간추정법을 이용한 교통수요추정)

  • Lee, Seung-Jae;Kim, Yong-Hoon
    • Journal of Korean Society of Transportation
    • /
    • v.26 no.2
    • /
    • pp.81-88
    • /
    • 2008
  • This paper presents the travel demand estimation using interval estimation methods during the trip generation stage, and then followed the other three stages of the four stage trip estimation. We have used real data of Dae-jun City. To estimate travel demand using the interval estimation method, a reliability level was set to 95% by a upper bound value, a middle value and a lower bound value. The four stage traffic demand analysis procedure was equally applied and finally interval traffic was estimated. The result showed a difference between maximum values and middle values depending on the destination during the trip generation stage. It depends on an explanation ability of regression analysis. Most of interval estimation ratio resulted in the traffic assignment stage showed ${\pm}5{\sim}18%$ difference on the average and ${\pm}30{\sim}50%$ at the most.

The Value of Calcium-scoring CT for Ischemic Cardiovascular Disease Screening (허혈성 심혈관 질환 선별을 위한 Calcium-scoring CT의 유용성)

  • Oh, Jung-Hoan;An, Sung-Min
    • Journal of radiological science and technology
    • /
    • v.32 no.1
    • /
    • pp.69-78
    • /
    • 2009
  • The cardiovascular disease has been known as a common cause of death for a long time in the west. The eating habits of Asia, including Korea, have changed recently, so that this disease is also a problem in Asia now. Annual Report on the Cause of Death Statistics from 1996 to 2006 reported that the cardiovascular disease would become the number one cause of death in the next $5{\sim}10$ years. Therefore we realize that more accurate examination is required. The aim of this study was to investigate the accuracy of Calcium-scoring CT and the relationship between risk factor and quantitative scores of Calcium-scoring CT. Through this study we expect that the national public health will be improved. Seventy patients with chest pain were chosen at random. The patients were undergone both coronary CT antigraphy and Calcium - scoring CT at G hospital in Incheon from February 1 to June 30, 2008. The result of the Calcium-scoring CT showed its usefulness for Ischemic cardiovascular disease, with an accuracy similar to that of exercise/pharmacologic stress or ECG when it is difficult for a patient to exercise due to joint problems, aging or for other reasons.

  • PDF