• Title/Summary/Keyword: Least Squares Estimator

Search Result 159, Processing Time 0.021 seconds

Limiting Distributions of Trimmed Least Squares Estimators in Unstable AR(1) Models

  • Lee, Sangyeol
    • Journal of the Korean Statistical Society
    • /
    • v.28 no.2
    • /
    • pp.151-165
    • /
    • 1999
  • This paper considers the trimmed least squares estimator of the autoregression parameter in the unstable AR(1) model: X\ulcorner=ØX\ulcorner+$\varepsilon$\ulcorner, where $\varepsilon$\ulcorner are iid random variables with mean 0 and variance $\sigma$$^2$> 0, and Ø is the real number with │Ø│=1. The trimmed least squares estimator for Ø is defined in analogy of that of Welsh(1987). The limiting distribution of the trimmed least squares estimator is derived under certain regularity conditions.

  • PDF

DETECTION OF OUTLIERS IN WEIGHTED LEAST SQUARES REGRESSION

  • Shon, Bang-Yong;Kim, Guk-Boh
    • Journal of applied mathematics & informatics
    • /
    • v.4 no.2
    • /
    • pp.501-512
    • /
    • 1997
  • In multiple linear regression model we have presupposed assumptions (independence normality variance homogeneity and so on) on error term. When case weights are given because of variance heterogeneity we can estimate efficiently regression parameter using weighted least squares estimator. Unfortunately this estimator is sen-sitive to outliers like ordinary least squares estimator. Thus in this paper we proposed some statistics for detection of outliers in weighted least squares regression.

An Equivariant and Robust Estimator in Multivariate Regression Based on Least Trimmed Squares

  • Jung, Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • v.10 no.3
    • /
    • pp.1037-1046
    • /
    • 2003
  • We propose an equivariant and robust estimator in multivariate regression model based on the least trimmed squares (LTS) estimator in univariate regression. We call this estimator as multivariate least trimmed squares (MLTS) estimator. The MLTS estimator considers correlations among response variables and it can be shown that the proposed estimator has the appropriate equivariance properties defined in multivariate regression. The MLTS estimator has high breakdown point as does LTS estimator in univariate case. We develop an algorithm for MLTS estimate. Simulation are performed to compare the efficiencies of MLTS estimate with coordinatewise LTS estimate and a numerical example is given to illustrate the effectiveness of MLTS estimate in multivariate regression.

Comparative Analysis of Learning Methods of Fuzzy Clustering-based Neural Network Pattern Classifier (퍼지 클러스터링기반 신경회로망 패턴 분류기의 학습 방법 비교 분석)

  • Kim, Eun-Hu;Oh, Sung-Kwun;Kim, Hyun-Ki
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.65 no.9
    • /
    • pp.1541-1550
    • /
    • 2016
  • In this paper, we introduce a novel learning methodology of fuzzy clustering-based neural network pattern classifier. Fuzzy clustering-based neural network pattern classifier depicts the patterns of given classes using fuzzy rules and categorizes the patterns on unseen data through fuzzy rules. Least squares estimator(LSE) or weighted least squares estimator(WLSE) is typically used in order to estimate the coefficients of polynomial function, but this study proposes a novel coefficient estimate method which includes advantages of the existing methods. The premise part of fuzzy rule depicts input space as "If" clause of fuzzy rule through fuzzy c-means(FCM) clustering, while the consequent part of fuzzy rule denotes output space through polynomial function such as linear, quadratic and their coefficients are estimated by the proposed local least squares estimator(LLSE)-based learning. In order to evaluate the performance of the proposed pattern classifier, the variety of machine learning data sets are exploited in experiments and through the comparative analysis of performance, it provides that the proposed LLSE-based learning method is preferable when compared with the other learning methods conventionally used in previous literature.

Lagged Unstable Regressor Models and Asymptotic Efficiency of the Ordinary Least Squares Estimator

  • Shin, Dong-Wan;Oh, Man-Suk
    • Journal of the Korean Statistical Society
    • /
    • v.31 no.2
    • /
    • pp.251-259
    • /
    • 2002
  • Lagged regressor models with general stationary errors independent of the regressors are considered. The regressor process is unstable having characteristic roots on the unit circle. If the order of the lag matches the number of roots on the unit circle, the ordinary least squares estimator (OLSE) is asymptotically efficient in that it has the same limiting distribution as the generalized least squares estimator (GLSE) under the same normalization. This result extends the well-known result of Grenander and Rosenblatt (1957) for asymptotic efficiency of the OLSE in deterministic polynomial and/or trigonometric regressor models to a class of models with stochastic regressors.

A Multiple Unit Roots Test Based on Least Squares Estimator

  • Shin, Key-Il
    • Journal of the Korean Statistical Society
    • /
    • v.28 no.1
    • /
    • pp.45-55
    • /
    • 1999
  • Knowing the number of unit roots is important in the analysis of k-dimensional multivariate autoregressive process. In this paper we suggest simple multiple unit roots test statistics based on least squares estimator for the multivariate AR(1) process in which some eigenvalues are one and the rest are less than one in magnitude. The empirical distributions are tabulated for suggested test statistics. We have small Monte-Calro studies to compare the powers of the test statistics suggested by Johansen(1988) and in this paper.

  • PDF

Adaptive L-estimation for regression slope under asymmetric error distributions (비대칭 오차모형하에서의 회귀기울기에 대한 적합된 L-추정법)

  • 한상문
    • The Korean Journal of Applied Statistics
    • /
    • v.6 no.1
    • /
    • pp.79-93
    • /
    • 1993
  • We consider adaptive L-estimation of estimating slope parameter in regression model. The proposed estimator is simple extension of trimmed least squares estimator proposed by ruppert and carroll. The efficiency of the proposed estimator is especially well compared with usual least squares estimator, least absolute value estimator, and M-estimators designed for asymmetric distributions under asymmetric error distributions.

  • PDF

Weighted Least Absolute Error Estimation of Regression Parameters

  • Song, Moon-Sup
    • Journal of the Korean Statistical Society
    • /
    • v.8 no.1
    • /
    • pp.23-36
    • /
    • 1979
  • In the multiple linear regression model a class of weighted least absolute error estimaters, which minimize the sum of weighted absolute residuals, is proposed. It is shown that the weighted least absolute error estimators with Wilcoxon scores are equivalent to the Koul's Wilcoxon type estimator. Therefore, the asymptotic efficiency of the proposed estimator with Wilcoxon scores relative to the least squares estimator is the same as the Pitman efficiency of the Wilcoxon test relative to the Student's t-test. To find the estimates the iterative weighted least squares method suggested by Schlossmacher is applicable.

  • PDF

Asymmetric Least Squares Estimation for A Nonlinear Time Series Regression Model

  • Kim, Tae Soo;Kim, Hae Kyoung;Yoon, Jin Hee
    • Communications for Statistical Applications and Methods
    • /
    • v.8 no.3
    • /
    • pp.633-641
    • /
    • 2001
  • The least squares method is usually applied when estimating the parameters in the regression models. However the least square estimator is not very efficient when the distribution of the error is skewed. In this paper, we propose the asymmetric least square estimator for a particular nonlinear time series regression model, and give the simple and practical sufficient conditions for the strong consistency of the estimators.

  • PDF

Expressions for Shrinkage Factors of PLS Estimator

  • Kim, Jong-Duk
    • Journal of the Korean Data and Information Science Society
    • /
    • v.17 no.4
    • /
    • pp.1169-1180
    • /
    • 2006
  • Partial least squares regression (PLS) is a biased, non-least squares regression method and is an alternative to the ordinary least squares regression (OLS) when predictors are highly collinear or predictors outnumber observations. One way to understand the properties of biased regression methods is to know how the estimators shrink the OLS estimator. In this paper, we introduce an expression for the shrinkage factor of PLS and develop a new shrinkage expression, and then prove the equivalence of the two representations. We use two near-infrared (NIR) data sets to show general behavior of the shrinkage and in particular for what eigendirections PLS expands the OLS coefficients.

  • PDF