• 제목/요약/키워드: Hot deck

검색결과 34건 처리시간 0.022초

K-nn을 이용한 Hot Deck 기반의 결측치 대체 (Imputation of Missing Data Based on Hot Deck Method Using K-nn)

  • 권순창
    • 한국IT서비스학회지
    • /
    • 제13권4호
    • /
    • pp.359-375
    • /
    • 2014
  • Researchers cannot avoid missing data in collecting data, because some respondents arbitrarily or non-arbitrarily do not answer questions in studies and experiments. Missing data not only increase and distort standard deviations, but also impair the convenience of estimating parameters and the reliability of research results. Despite widespread use of hot deck, researchers have not been interested in it, since it handles missing data in ambiguous ways. Hot deck can be complemented using K-nn, a method of machine learning, which can organize donor groups closest to properties of missing data. Interested in the role of k-nn, this study was conducted to impute missing data based on the hot deck method using k-nn. After setting up imputation of missing data based on hot deck using k-nn as a study objective, deletion of listwise, mean, mode, linear regression, and svm imputation were compared and verified regarding nominal and ratio data types and then, data closest to original values were obtained reasonably. Simulations using different neighboring numbers and the distance measuring method were carried out and better performance of k-nn was accomplished. In this study, imputation of hot deck was re-discovered which has failed to attract the attention of researchers. As a result, this study shall be able to help select non-parametric methods which are less likely to be affected by the structure of missing data and its causes.

Imputation Methods for the Population and Housing Census 2000 in Korea

  • Kim, Young-Won;Ryu, Jeabok;Park, Jinwoo;Lee, Jaewon
    • Communications for Statistical Applications and Methods
    • /
    • 제10권2호
    • /
    • pp.575-583
    • /
    • 2003
  • We proposed imputation strategies for the Population and Housing Census 2000 in Korea. The total area of floor space and marital status which have relatively high non-response rates in the Census are considered to develope the effective missing value imputation procedures. The Classification and Regression Tree(CART) is employed to construct the imputation cells for hot-deck imputation, as well as to predict missing value by model-based approach. We compare three imputation methods which include CART model-based imputation, hot-deck imputation based on CART and logical hot-deck imputation proposed by The Korea National Statistical Office. The results suggest that the proposed hot-deck imputation based on CART is very efficient and strongly recommendable.

CART를 활용한 결측값 대체방법 : 인구주택총조사 혼인상태 항목을 중심으로 (Missing Value Imputation Method Using CART : For Marital Status in the Population and Housing Census)

  • 김영원;이주원
    • 한국조사연구학회지:조사연구
    • /
    • 제4권2호
    • /
    • pp.1-21
    • /
    • 2003
  • 본 연구예서는 일반적인 사회조사에서 사용될 수 있는 효과적인 결측값 대체방법을 검토하기 위해 인구주택총조사 조사항목 중 혼인상태의 결측값을 대체할 수 있는 두 가지 방법을 제안하고 있다. 첫 번째 방법은 CART(Classification and Regression Tree)모형에서 얻어진 최대 예측확률을 기준으로 결측값을 대체하는 일종의 모형기반 접근법이고, 두 번째 방법은 CART 모형에서 얻어진 결과를 근거로 대체층을 구성하여 핫덱(hot-deck) 방법을 적용하는 대체방법이다. 효율성 비교를 위해 2000년 인구주택총조사를 위한 시험조사에서 얻어진 제조사 결과를 이용하여 오분류율을 검토해 본 결과 두 방법 중 CART 모형을 기반으로 핫덱 방법을 적용하는 것이 효율적이라는 결론을 얻을 수 있었다. 아울러 전국에 대해 동일한 모형을 설정한 경우와 거주지 특성에 따라 광역시$.$도의 동지역, 도의 읍$.$면지역으로 구분하여 대체방법을 적용하는 경우를 비교해 본 결과 지역 구분을 통한 효율성 향상 효과는 미흡한 것으로 파악되었다.

  • PDF

Jackknife Variance Estimation under Imputation for Nonrandom Nonresponse with Follow-ups

  • Park, Jinwoo
    • Journal of the Korean Statistical Society
    • /
    • 제29권4호
    • /
    • pp.385-394
    • /
    • 2000
  • Jackknife variance estimation based on adjusted imputed values when nonresponse is nonrandom and follow-up data are available for a subsample of nonrespondents is provided. Both hot-deck and ratio imputation method are considered as imputation method. The performance of the proposed variance estimator under nonrandom response mechanism is investigated through numerical simulation.

  • PDF

REGRESSION FRACTIONAL HOT DECK IMPUTATION

  • Kim, Jae-Kwang
    • Journal of the Korean Statistical Society
    • /
    • 제36권3호
    • /
    • pp.423-434
    • /
    • 2007
  • Imputation using a regression model is a method to preserve the correlation among variables and to provide imputed point estimators. We discuss the implementation of regression imputation using fractional imputation. By a suitable choice of fractional weights, the fractional regression imputation can take the form of hot deck fractional imputation, thus no artificial values are constructed after the imputation. A variance estimator, which extends the method of Kim and Fuller (2004), is also proposed. Results from a limited simulation study are presented.

Fatigue Strength and Root-Deck Crack Propagation for U-Rib to Deck Welded Joint in Steel Box Girder

  • Zhiyuan, YuanZhou;Bohai, Ji;Di, Li;Zhongqiu, Fu
    • 국제강구조저널
    • /
    • 제18권5호
    • /
    • pp.1589-1597
    • /
    • 2018
  • Fatigue tests and numerical analysis were carried out to evaluate the fatigue performance at the U-rib to deck welded joint in steel box girder. Twenty specimens were tested corresponding to different penetration rates (80 and 100%) under fatigue bending load, and the fatigue strength was investigated based on hot spot stress (HSS) method. The detailed stress distribution at U-rib to deck welded joint was analyzed by the finite element method, as well as the stress intensity factor of weld root. The test results show that the specimens with fully penetration rate have longer crack propagation life due to the welding geometry, resulting in higher fatigue failure strength. The classification of FAT-90 is reasonable for evaluating fatigue strength by HSS method. The penetration rate has effect on crack propagation angle near the surface, and the 1-mm stress below weld toe and root approves to be more suitable for fatigue stress assessment, because of its high sensitivity to weld geometry than HSS.

Research on rib-to-diaphragm welded connection by means of hot spot stress approach

  • Wang, Binhua;Lu, Pengmin;Shao, Yuhong
    • Steel and Composite Structures
    • /
    • 제18권1호
    • /
    • pp.135-148
    • /
    • 2015
  • The cutout hole locating at the place of rib-to-diaphragm welded connection is adopted to minimize the restraint, which is caused by the floor-beam web to rib rotation at the support due to the unsymmetrical loads in orthotropic deck. In practice, an inevitable problem is that there is a large number of welding joint's cracks formed at the edge of cutout hole. In this study, a comparative experiment is carried out with two types of cutout hole, the circular arc transition and the vertical transition. The fatigue life estimation of specimens is investigated with the application of the structural hot spot stress approach by finite element analyses. The results are compared with the ones of the fatigue tests which are carried out on these full-scale specimens. Factors affecting the stress range are also studied.

농어가경제조사에서 가중핫덱 무응답 대체법의 활용 (Weighted Hot-Deck Imputation in Farm and Fishery Household Economy Surveys)

  • 김규성;이기재;김진
    • 응용통계연구
    • /
    • 제18권2호
    • /
    • pp.311-328
    • /
    • 2005
  • 본 논문은 농어가경제조사에서 발생하는 무응답을 처리하는 방법에 관한 것이다. 농어가경제조사는 모두 층화다단표집을 한 후 가중평균으로 모평균을 추정하므로 이에 적합한 대체법으로 가중핫덱 대체법을 고려하여 가중핫덱 대체 절차와 모평균 추정법, 그리고 대응되는 분산추정법을 고찰하였다. 그리고 모의실험을 통하여 가중핫덱 대체가 두 조사에 적용될 수 있음을 보였고 수정된 잭나이프 분산추정법을 사용하면 추정치의 신뢰도도 효과적으로 나타낼 수 있음을 보였다. 또한 두 조사에 적용할 수 있는 대체군 형성 절차를 제시하고, 예로써 각각 4가지 방안을 비교, 분석하였다. 그리고 그 중 가장 효율적인 방안을 결과로써 제시하였다.

Basalt 콘크리트 섬유보강 상판의 거동에 관한 기초적 연구 (The Fundamental Study on the Behavior of Deck Slab Reinforced Basalt Fiber)

  • 서성탁
    • 한국산업융합학회 논문집
    • /
    • 제14권1호
    • /
    • pp.1-7
    • /
    • 2011
  • Basalt originates from volcanic magma and flood volcanoes, a very hot fluid or semifluid material under the earth's crust, solidified in the open air. Basalt is a common term used for a variety of volcanic rocks, which are gray, dark in colour, formed from the molten lava after solidification. Recently, attention has been devoted to continuous basalt fibers (CBF) whose primary advantage consists in their low cost, good resistance to acids and solvents, and good thermal stability. In order to investigate reinforcement effect, this paper did FEM analysis with shell element. The result were as follows; BCF deck plate did elastic behavior to 450 kN, reinforcement effect of basalt fiber (BF) was less. But BCF's perpendicular deflection occurred little about 23 mm comparing with RC deck plate in load 627 kN. Stiffness was very improved by basalt fiber reinforcement.