• Title/Summary/Keyword: Nonlinear Least Squares

Search Result 227, Processing Time 0.03 seconds

Asymmetric Least Squares Estimation for A Nonlinear Time Series Regression Model

  • Kim, Tae Soo;Kim, Hae Kyoung;Yoon, Jin Hee
    • Communications for Statistical Applications and Methods
    • /
    • v.8 no.3
    • /
    • pp.633-641
    • /
    • 2001
  • The least squares method is usually applied when estimating the parameters in the regression models. However the least square estimator is not very efficient when the distribution of the error is skewed. In this paper, we propose the asymmetric least square estimator for a particular nonlinear time series regression model, and give the simple and practical sufficient conditions for the strong consistency of the estimators.

  • PDF

NONLINEAR ASYMMETRIC LEAST SQUARES ESTIMATORS

  • Park, Seung-Hoe;Kim, Hae-Kyung;Lee, Young
    • Journal of the Korean Statistical Society
    • /
    • v.32 no.1
    • /
    • pp.47-64
    • /
    • 2003
  • In this paper, we consider the asymptotic properties of asymmetric least squares estimators for nonlinear regression models. This paper provides sufficient conditions for strong consistency and asymptotic normality of the proposed estimators and derives asymptotic relative efficiency of the pro-posed estimators to the regression quantile estimators. We give some examples and results of a Monte Carlo simulation to compare the asymmetric least squares estimators with the regression quantile estimators.

Asymmetric least squares regression estimation using weighted least squares support vector machine

  • Hwan, Chang-Ha
    • Journal of the Korean Data and Information Science Society
    • /
    • v.22 no.5
    • /
    • pp.999-1005
    • /
    • 2011
  • This paper proposes a weighted least squares support vector machine for asymmetric least squares regression. This method achieves nonlinear prediction power, while making no assumption on the underlying probability distributions. The cross validation function is introduced to choose optimal hyperparameters in the procedure. Experimental results are then presented which indicate the performance of the proposed model.

DUAL REGULARIZED TOTAL LEAST SQUARES SOLUTION FROM TWO-PARAMETER TRUST-REGION ALGORITHM

  • Lee, Geunseop
    • Journal of the Korean Mathematical Society
    • /
    • v.54 no.2
    • /
    • pp.613-626
    • /
    • 2017
  • For the overdetermined linear system, when both the data matrix and the observed data are contaminated by noise, Total Least Squares method is an appropriate approach. Since an ill-conditioned data matrix with noise causes a large perturbation in the solution, some kind of regularization technique is required to filter out such noise. In this paper, we consider a Dual regularized Total Least Squares problem. Unlike the Tikhonov regularization which constrains the size of the solution, a Dual regularized Total Least Squares problem considers two constraints; one constrains the size of the error in the data matrix, the other constrains the size of the error in the observed data. Our method derives two nonlinear equations to construct the iterative method. However, since the Jacobian matrix of two nonlinear equations is not guaranteed to be nonsingular, we adopt a trust-region based iteration method to obtain the solution.

The Strong Consistency of Nonlinear Least Squares Estimators

  • Kim, Hae-Kyung
    • Journal of the Korean Statistical Society
    • /
    • v.18 no.2
    • /
    • pp.85-96
    • /
    • 1989
  • This paper is concerned with the strong consistency of the least squares estimators for the nonlinear regression models. A simple and practical sufficient condition for the strong consistency of the least squares estimators is given. It is also discussed that the extension of the strong consistency to a wide class of regression functions can be established by imposing some condition on the input values. Some examples are given to illustrate the application of main result.

  • PDF

Real-time Projectile Motion Trajectory Estimation Considering Air Resistance of Obliquely Thrown Object Using Recursive Least Squares Estimation (비스듬히 던진 물체의 공기저항을 고려한 재귀 최소 자승법 기반 실시간 포물선 운동 궤적 추정)

  • Jeong, Sangyoon;Chwa, Dongkyoung
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.67 no.3
    • /
    • pp.427-432
    • /
    • 2018
  • This paper uses a recursive least squares method to estimate the projectile motion trajectory of an object in real time. The equations of motion of the object are obtained considering the air resistance which occurs in the actual experiment environment. Because these equations consider air resistance, parameter estimation of nonlinear terms is required. However, nonlinear recursive least squares estimation is not suitable for estimating trajectory of projectile in that it requires a lot of computation time. Therefore, parameter estimation for real-time trajectory prediction is performed by recursive least square estimation after using Taylor series expansion to approximate nonlinear terms to polynomials. The proposed method is verified through experiments by using VICON Bonita motion capture system which can get three dimensional coordinates of projectile. The results indicate that proposed method is more accurate than linear Kalman filter method based on the equations of motion of projectile that does not consider air resistance.

THE STRONG CONSISTENCY OF THE ASYMMETRIC LEAST SQUARES ESTIMATORS IN NONLINEAR CENSORED REGRESSION MODELS

  • Choi, Seung-Hoe;Kim, Hae-Kyung
    • Communications of the Korean Mathematical Society
    • /
    • v.18 no.4
    • /
    • pp.703-712
    • /
    • 2003
  • This paper deals with the strong consistency of the asymmetric least squares for the nonlinear censored regression models which includes dependent variables cut off midway by any of external conditions, and provide the sufficient conditions which ensure the strong consistency of proposed estimators of the censored regression models. One example is given to illustrate the application of the main result.

Statistical Estimation and Algorithm in Nonlinear Functions

  • Jea-Young Lee
    • Communications for Statistical Applications and Methods
    • /
    • v.2 no.2
    • /
    • pp.135-145
    • /
    • 1995
  • A new algorithm was given to successively fit the multiexponential function/nonlinear function to data by a weighted least squares method, using Gauss-Newton, Marquardt, gradient and DUD methods for convergence. This study also considers the problem of linear-nonlimear weighted least squares estimation which is based upon the usual Taylor's formula process.

  • PDF

EXTENDING THE APPLICABILITY OF INEXACT GAUSS-NEWTON METHOD FOR SOLVING UNDERDETERMINED NONLINEAR LEAST SQUARES PROBLEMS

  • Argyros, Ioannis Konstantinos;Silva, Gilson do Nascimento
    • Journal of the Korean Mathematical Society
    • /
    • v.56 no.2
    • /
    • pp.311-327
    • /
    • 2019
  • The aim of this paper is to extend the applicability of Gauss-Newton method for solving underdetermined nonlinear least squares problems in cases not covered before. The novelty of the paper is the introduction of a restricted convergence domain. We find a more precise location where the Gauss-Newton iterates lie than in earlier studies. Consequently the Lipschitz constants are at least as small as the ones used before. This way and under the same computational cost, we extend the local as well the semilocal convergence of Gauss-Newton method. The new developmentes are obtained under the same computational cost as in earlier studies, since the new Lipschitz constants are special cases of the constants used before. Numerical examples further justify the theoretical results.

Closed-form Nonlinear Least-Squares Source Localization from Time-Difference of Arrival Measurements in Planar Space (평면공간에서 다중 센서간 도달 시간차를 이용한 해석적인 최소제곱오차 음원 위치 추정 방법)

  • Shin, Dong-Hoon
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.14 no.4
    • /
    • pp.694-699
    • /
    • 2011
  • A closed-form technique is presented for estimating a single source location from a set of noisy time delay measurements between distributed sensors. The localization formula is derived from nonlinear least squares minimization over the unknowns of target range and bearing in polar coordinates. Computer simulation results are provided for the purpose of performance analysis. Constrained least squares minimization method with prior source location information is also discussed.