• Title/Summary/Keyword: Least-squares minimization

Search Result 40, Processing Time 0.022 seconds

An Error-Bounded B-spline Fitting Technique to Approximate Unorganized Data (무작위 데이터 근사화를 위한 유계오차 B-스플라인 근사법)

  • Park, Sang-Kun
    • Korean Journal of Computational Design and Engineering
    • /
    • v.17 no.4
    • /
    • pp.282-293
    • /
    • 2012
  • This paper presents an error-bounded B-spline fitting technique to approximate unorganized data within a prescribed error tolerance. The proposed approach includes two main steps: leastsquares minimization and error-bounded approximation. A B-spline hypervolume is first described as a data representation model, which includes its mathematical definition and the data structure for implementation. Then we present the least-squares minimization technique for the generation of an approximate B-spline model from the given data set, which provides a unique solution to the problem: overdetermined, underdetermined, or ill-conditioned problem. We also explain an algorithm for the error-bounded approximation which recursively refines the initial base model obtained from the least-squares minimization until the Euclidean distance between the model and the given data is within the given error tolerance. The proposed approach is demonstrated with some examples to show its usefulness and a good possibility for various applications.

Closed-form Nonlinear Least-Squares Source Localization from Time-Difference of Arrival Measurements in Planar Space (평면공간에서 다중 센서간 도달 시간차를 이용한 해석적인 최소제곱오차 음원 위치 추정 방법)

  • Shin, Dong-Hoon
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.14 no.4
    • /
    • pp.694-699
    • /
    • 2011
  • A closed-form technique is presented for estimating a single source location from a set of noisy time delay measurements between distributed sensors. The localization formula is derived from nonlinear least squares minimization over the unknowns of target range and bearing in polar coordinates. Computer simulation results are provided for the purpose of performance analysis. Constrained least squares minimization method with prior source location information is also discussed.

AN ITERATIVE ALGORITHM FOR THE LEAST SQUARES SOLUTIONS OF MATRIX EQUATIONS OVER SYMMETRIC ARROWHEAD MATRICES

  • Ali Beik, Fatemeh Panjeh;Salkuyeh, Davod Khojasteh
    • Journal of the Korean Mathematical Society
    • /
    • v.52 no.2
    • /
    • pp.349-372
    • /
    • 2015
  • This paper concerns with exploiting an oblique projection technique to solve a general class of large and sparse least squares problem over symmetric arrowhead matrices. As a matter of fact, we develop the conjugate gradient least squares (CGLS) algorithm to obtain the minimum norm symmetric arrowhead least squares solution of the general coupled matrix equations. Furthermore, an approach is offered for computing the optimal approximate symmetric arrowhead solution of the mentioned least squares problem corresponding to a given arbitrary matrix group. In addition, the minimization property of the proposed algorithm is established by utilizing the feature of approximate solutions derived by the projection method. Finally, some numerical experiments are examined which reveal the applicability and feasibility of the handled algorithm.

A SPLIT LEAST-SQUARES CHARACTERISTIC MIXED ELEMENT METHOD FOR SOBOLEV EQUATIONS WITH A CONVECTION TERM

  • Ohm, Mi Ray;Shin, Jun Yong
    • East Asian mathematical journal
    • /
    • v.35 no.5
    • /
    • pp.569-587
    • /
    • 2019
  • In this paper, we consider a split least-squares characteristic mixed element method for Sobolev equations with a convection term. First, to manipulate both convection term and time derivative term efficiently, we apply a characteristic mixed element method to get the system of equations in the primal unknown and the flux unknown and then get a least-squares minimization problem and a least-squares characteristic mixed element scheme. Finally, we obtain a split least-squares characteristic mixed element scheme for the given problem whose system is uncoupled in the unknowns. We prove the optimal order in $L^2$ and $H^1$ normed spaces for the primal unknown and the suboptimal order in $L^2$ normed space for the flux unknown.

A HIGHER ORDER SPLIT LEAST-SQUARES CHARACTERISTIC MIXED ELEMENT METHOD FOR SOBOLEV EQUATIONS

  • Ohm, Mi Ray;Shin, Jun Yong
    • East Asian mathematical journal
    • /
    • v.38 no.3
    • /
    • pp.293-319
    • /
    • 2022
  • In this paper, we introduce a higher order split least-squares characteristic mixed element scheme for Sobolev equations. First, we use a characteristic mixed element method to manipulate both convection term and time derivative term efficiently and obtain the system of equations in the primal unknown and the flux unknown. Second, we define a least-squares minimization problem and a least-squares characteristic mixed element scheme. Finally, we obtain a split least-squares characteristic mixed element scheme for the given problem whose system is uncoupled in the unknowns. We establish the convergence results for the primal unknown and the flux unknown with the second order in a time increment.

A Comparative Study on Single Time Schemes Based on the FEM for the Analysis of Structural Transient Problems (구조물의 시간에 따른 거동 해석을 위한 유한요소법에 기초한 단일 스텝 시간 범주들의 비교연구)

  • Kim, Woo-Ram;Choi, Youn-Dae
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.14 no.5
    • /
    • pp.957-964
    • /
    • 2011
  • New time schemes based on the FEM were developed and their performances were tested with 2D wave equation. The least-squares and weighted residual methods are used to construct new time schemes based on traditional residual minimization method. To overcome some drawbacks that time schemes based on the least-squares and weighted residual methods have, ad-hoc method is considered to minimize residuals multiplied by others residuals as a new approach. And variational method is used to get necessary conditions of ad-hoc minimization. A-stability was chosen to check the stability of newly developed time schemes. Specific values of new time schemes are presented along with their numerical solutions which were compared with analytic solution.

A transductive least squares support vector machine with the difference convex algorithm

  • Shim, Jooyong;Seok, Kyungha
    • Journal of the Korean Data and Information Science Society
    • /
    • v.25 no.2
    • /
    • pp.455-464
    • /
    • 2014
  • Unlabeled examples are easier and less expensive to obtain than labeled examples. Semisupervised approaches are used to utilize such examples in an eort to boost the predictive performance. This paper proposes a novel semisupervised classication method named transductive least squares support vector machine (TLS-SVM), which is based on the least squares support vector machine. The proposed method utilizes the dierence convex algorithm to derive nonconvex minimization solutions for the TLS-SVM. A generalized cross validation method is also developed to choose the hyperparameters that aect the performance of the TLS-SVM. The experimental results conrm the successful performance of the proposed TLS-SVM.

QR-Decomposition based Adaptive Bbilinear Lattice Algorithms (QR 분해법을 이용한 적응 쌍선형 격자 알고리듬)

  • 안봉만;황지원;백흥기
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.31B no.10
    • /
    • pp.32-43
    • /
    • 1994
  • This paper presents new QRD-based recursive least squares algorithms for bilinear lattice filter. Bilinear recursive least square lattice algorithms are derived by using the QR decomposition for minimization covariance matrix of predication error by applying Givens rotation to the bilinear recursive least squares lattics algorithms. The proposed algorithms are applied to the bilinear system identification to evaluate the performance of algoithms. Computer simulations show that the convergence properties of the proposed algorithms are superior to that of the algorithms proposed by Baik when signal includes the measurement noise.

  • PDF

Inversion of Geophysical Data with Robust Estimation (로버스트추정에 의한 지구물리자료의 역산)

  • Kim, Hee Joon
    • Economic and Environmental Geology
    • /
    • v.28 no.4
    • /
    • pp.433-438
    • /
    • 1995
  • The most popular minimization method is based on the least-squares criterion, which uses the $L_2$ norm to quantify the misfit between observed and synthetic data. The solution of the least-squares problem is the maximum likelihood point of a probability density containing data with Gaussian uncertainties. The distribution of errors in the geophysical data is, however, seldom Gaussian. Using the $L_2$ norm, large and sparsely distributed errors adversely affect the solution, and the estimated model parameters may even be completely unphysical. On the other hand, the least-absolute-deviation optimization, which is based on the $L_1$ norm, has much more robust statistical properties in the presence of noise. The solution of the $L_1$ problem is the maximum likelihood point of a probability density containing data with longer-tailed errors than the Gaussian distribution. Thus, the $L_1$ norm gives more reliable estimates when a small number of large errors contaminate the data. The effect of outliers is further reduced by M-fitting method with Cauchy error criterion, which can be performed by iteratively reweighted least-squares method.

  • PDF

Robust inversion of seismic data using ${\ell}^1/{\ell}^2$ norm IRLS method (${\ell}^1/{\ell}^2$ norm IRLS 방법을 사용한 강인한 탄성파자료역산)

  • Ji Jun
    • 한국지구물리탐사학회:학술대회논문집
    • /
    • 2005.05a
    • /
    • pp.227-232
    • /
    • 2005
  • Least squares (${\ell}^2-norm$) solutions of seismic inversion tend to be very sensitive to data points with large errors. The ${\ell}^p-norm$ minimization for $1{\le}p<2$ gives more robust solutions, but usually with higher computational cost. Iteratively reweighted least squares (IRLS) gives efficient approximate solutions of these ${\ell}^p-norm$ problems. I propose a simple way to implement the IRLS method for a hybrid ${\ell}^1/{\ell}^2$ minimization problem that behaves as ${\ell}^2$ fit for small residual and ${\ell}^1$ fit for large residuals. Synthetic and a field-data examples demonstrates the improvement of the hybrid method over least squares when there are outliers in the data.

  • PDF