• Title/Summary/Keyword: Least square estimator

Search Result 133, Processing Time 0.026 seconds

Design-based Properties of Least Square Estimators in Panel Regression Model (패널회귀모형에서 회귀계수 추정량의 설계기반 성질)

  • Kim, Kyu-Seong
    • Survey Research
    • /
    • v.12 no.3
    • /
    • pp.49-62
    • /
    • 2011
  • In this paper we investigate design-based properties of both the ordinary least square estimator and the weighted least square estimator for regression coefficients in panel regression model. We derive formulas of approximate bias, variance and mean square error for the ordinary least square estimator and approximate variance for the weighted least square estimator after linearization of least square estimators. Also we compare their magnitudes each other numerically through a simulation study. We consider a three years data of Korean Welfare Panel Study as a finite population and take household income as a dependent variable and choose 7 exploratory variables related household as independent variables in panel regression model. Then we calculate approximate bias, variance, mean square error for the ordinary least square estimator and approximate variance for the weighted least square estimator based on several sample sizes from 50 to 1,000 by 50. Through the simulation study we found some tendencies as follows. First, the mean square error of the ordinary least square estimator is getting larger than the variance of the weighted least square estimator as sample sizes increase. Next, the magnitude of mean square error of the ordinary least square estimator is depending on the magnitude of the bias of the estimator, which is large when the bias is large. Finally, with regard to approximate variance, variances of the ordinary least square estimator are smaller than those of the weighted least square estimator in many cases in the simulation.

  • PDF

Reexamination of Estimating Beta Coecient as a Risk Measure in CAPM

  • Phuoc, Le Tan;Kim, Kee S.;Su, Yingcai
    • The Journal of Asian Finance, Economics and Business
    • /
    • v.5 no.1
    • /
    • pp.11-16
    • /
    • 2018
  • This research examines the alternative ways of estimating the coefficient of non-diversifiable risk, namely beta coefficient, in Capital Asset Pricing Model (CAPM) introduced by Sharpe (1964) that is an essential element of assessing the value of diverse assets. The non-parametric methods used in this research are the robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator). The Jackknife, the resampling technique, is also employed to validate the results. According to finance literature and common practices, these coecients have often been estimated using Ordinary Least Square (LS) regression method and monthly return data set. The empirical results of this research pointed out that the robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator) performed much better than Ordinary Least Square (LS) in terms of eciency for large-cap stocks trading actively in the United States markets. Interestingly, the empirical results also showed that daily return data would give more accurate estimation than monthly return data in both Ordinary Least Square (LS) and robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator) regressions.

Least Mean Square Estimator for Motor Frequency Measurement Based on Linear Hall Sensor (선형 홀센서 기반의 모터 회전속도 측정을 위한 평균 최소 자승 추정기)

  • Choi, Ga-Hyoung;Ra, Won-Sang;Kwak, Ki-Seok;Yoon, Tae-Sung;Park, Jin-Bae
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.57 no.5
    • /
    • pp.866-874
    • /
    • 2008
  • Motor frequency can be measured by a hall sensor. Among the many hall sensors, a linear type hall sensor is good at high accuracy frequency measuring problem. However, in general, this linear type hall sensor has DC offset which can vary along sensor's operating voltage change. Therefore, In motor frequency measurement problem using the linear hall sensor, it needs an estimator that can estimate frequency and DC offset simultaneously. In this paper, we propose the least mean square estimator to estimate motor frequency. To verify its performance, we compare the LMS estimator with a commercial analog tachometer. Experimental results shows the proposed LMS estimator works well in varying frequency and stationary DC offset.

Approximate Variance of Least Square Estimators for Regression Coefficient under Inclusion Probability Proportional to Size Sampling (포함확률비례추출에서 회귀계수 최소제곱추정량의 근사분산)

  • Kim, Kyu-Seong
    • Communications for Statistical Applications and Methods
    • /
    • v.19 no.1
    • /
    • pp.23-32
    • /
    • 2012
  • This paper deals with the bias and variance of regression coefficient estimators in a finite population. We derive approximate formulas for the bias, variance and mean square error of two estimators when we select a fixed-size inclusion probability proportional to the size sample and then estimate regression coefficients by the ordinary least square estimator as well as the weighted least square estimator based on the selected sample data. Necessary and sufficient conditions for the comparison of the two estimators in terms of variance and mean square error are suggested. In addition, a simple example is introduced to numerically compare the variance and mean square error of the two estimators.

Asymmetric Least Squares Estimation for A Nonlinear Time Series Regression Model

  • Kim, Tae Soo;Kim, Hae Kyoung;Yoon, Jin Hee
    • Communications for Statistical Applications and Methods
    • /
    • v.8 no.3
    • /
    • pp.633-641
    • /
    • 2001
  • The least squares method is usually applied when estimating the parameters in the regression models. However the least square estimator is not very efficient when the distribution of the error is skewed. In this paper, we propose the asymmetric least square estimator for a particular nonlinear time series regression model, and give the simple and practical sufficient conditions for the strong consistency of the estimators.

  • PDF

A Comparison of Estimation Methods for Weibull Distribution and Type I Censoring (와이블 분포와 정시중단 하에서의 MLE와 LSE의 정확도 비교)

  • Kim, Seong-Il;Park, Min-Yong;Park, Jung-Won
    • Journal of Korean Society for Quality Management
    • /
    • v.38 no.4
    • /
    • pp.480-490
    • /
    • 2010
  • In this paper, two estimation methods(least square estimation and maximum likelihood estimation) were compared for Weibull distribution and Type I censoring. Data obtained by Monte Carlo simulation were analyzed using two estimation methods and analysis results were compared by MSE(Mean Squared Error). Comparison results show that maximum likelihood estimator is better for censored data and complete data with more than 30 samples and least square estimator is better for small size complete data(less than and equal to 20 samples).

GOODNESS-OF-FIT TEST USING LOCAL MAXIMUM LIKELIHOOD POLYNOMIAL ESTIMATOR FOR SPARSE MULTINOMIAL DATA

  • Baek, Jang-Sun
    • Journal of the Korean Statistical Society
    • /
    • v.33 no.3
    • /
    • pp.313-321
    • /
    • 2004
  • We consider the problem of testing cell probabilities in sparse multinomial data. Aerts et al. (2000) presented T=${{\Sigma}_{i=1}}^{k}{[{p_i}^{*}-E{(p_{i}}^{*})]^2$ as a test statistic with the local least square polynomial estimator ${{p}_{i}}^{*}$, and derived its asymptotic distribution. The local least square estimator may produce negative estimates for cell probabilities. The local maximum likelihood polynomial estimator ${{\hat{p}}_{i}}$, however, guarantees positive estimates for cell probabilities and has the same asymptotic performance as the local least square estimator (Baek and Park, 2003). When there are cell probabilities with relatively much different sizes, the same contribution of the difference between the estimator and the hypothetical probability at each cell in their test statistic would not be proper to measure the total goodness-of-fit. We consider a Pearson type of goodness-of-fit test statistic, $T_1={{\Sigma}_{i=1}}^{k}{[{p_i}^{*}-E{(p_{i}}^{*})]^2/p_{i}$ instead, and show it follows an asymptotic normal distribution. Also we investigate the asymptotic normality of $T_2={{\Sigma}_{i=1}}^{k}{[{p_i}^{*}-E{(p_{i}}^{*})]^2/p_{i}$ where the minimum expected cell frequency is very small.

The adaptive reduced state sequence estimation receiver for multipath fading channels (이동통신 환경에서 적응상태 축약 심볼열 추정 수신기)

  • 이영조;권성락;문태현;강창언
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.22 no.7
    • /
    • pp.1468-1476
    • /
    • 1997
  • In mobile communication systems, the Reduced State Sequence Estimation(RSSE) receiver must be able to track changes in the channel. This is carried out by the adaptive channel estimator. However, when the tentative decisions are used in the channel estimator, incorrect decisions can cause error propagation. This paper presents a new channel estimator using the path history in the Viterbi decoder for preventing error propagation. The selection of the path history in the Viterbi decoder for preventing error propagation. The selection of the path history for the channel estimator depends on the path metric as in the decoding of the Viterbi decoder in RSSE. And a discussion on the channel estimator with different adaptation algorithms such as Least Mean Square(LMS) algorithm and Recursive Least Square(RLS) algorithm is provided. Results from computer simulations show that the RSSE receivers using the proposed channel estimator have better performance than the other conventional RSSE receiver, and that the channel estimator with RLS algorithm is adequate for multipath fading channel.

  • PDF

An Estimation of Parameters in Weibull Distribution Using Least Squares Method under Random Censoring Model (임의 중단모형에서 최소제곱법을 이용한 와이블분포의 모수 추정)

  • Lee, Woo-Dong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.7 no.2
    • /
    • pp.263-272
    • /
    • 1996
  • In this parer, under random censorship model, an estimation of scale and shape parameters in Weibull lifetime model is considered. Based on nonparametric estimator of survival function, the least square method is proposed. The proposed estimation method is simple and the performance of the proposed estimator is as efficient as maximum likelihood estimators. An example is presented, using field winding data. Simulation studies are performed to compare the performaces of the proposed estimator and maximum likelihood estimator.

  • PDF

Comparison of Model Fitting & Least Square Estimator for Detecting Mura (Mura 검출을 위한 Model Fitting 및 Least Square Estimator의 비교)

  • Oh, Chang-Hwan;Joo, Hyo-Nam;Rew, Keun-Ho
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.14 no.5
    • /
    • pp.415-419
    • /
    • 2008
  • Detecting and correcting defects on LCD glasses early in the manufacturing process becomes important for panel makers to reduce the manufacturing costs and to improve productivity. Many attempts have been made and were successfully applied to detect and identify simple defects such as scratches, dents, and foreign objects on glasses. However, it is still difficult to robustly detect low-contrast defect region, called Mura or blemish area on glasses. Typically, these defect areas are roughly defined as relatively large, several millimeters of diameter, and relatively dark and/or bright region of low Signal-to-Noise Ratio (SNR) against background of low-frequency signal. The aim of this article is to present a robust algorithm to segment these blemish defects. Early 90's, a highly robust estimator, known as the Model-Fitting (MF) estimator was developed by X. Zhuang et. al. and have been successfully used in many computer vision application. Compared to the conventional Least-Square (LS) estimator the MF estimator can successfully estimate model parameters from a dataset of contaminated Gaussian mixture. Such a noise model is defined as a regular white Gaussian noise model with probability $1-\varepsilon$ plus an outlier process with probability $varepsilon$. In the sense of robust estimation, the blemish defect in images can be considered as being a group of outliers in the process of estimating image background model parameters. The algorithm developed in this paper uses a modified MF estimator to robustly estimate the background model and as a by-product to segment the blemish defects, the outliers.