Journal of the Korean Mathematical Society (대한수학회지)

Korean Mathematical Society (대한수학회)
권호 표지
DOI QR코드

DOI QR Code

DUAL REGULARIZED TOTAL LEAST SQUARES SOLUTION FROM TWO-PARAMETER TRUST-REGION ALGORITHM

  • Lee, Geunseop (Test and Package Center Samsung Electronics Co. Ltd)
  • Received : 2016.03.07
  • Published : 2017.03.01
Download PDF
⟨ Previous Next ⟩

Abstract

For the overdetermined linear system, when both the data matrix and the observed data are contaminated by noise, Total Least Squares method is an appropriate approach. Since an ill-conditioned data matrix with noise causes a large perturbation in the solution, some kind of regularization technique is required to filter out such noise. In this paper, we consider a Dual regularized Total Least Squares problem. Unlike the Tikhonov regularization which constrains the size of the solution, a Dual regularized Total Least Squares problem considers two constraints; one constrains the size of the error in the data matrix, the other constrains the size of the error in the observed data. Our method derives two nonlinear equations to construct the iterative method. However, since the Jacobian matrix of two nonlinear equations is not guaranteed to be nonsingular, we adopt a trust-region based iteration method to obtain the solution.

Keywords

References

  1. G. Arfken, Mathematical Methods for Physicists, Third edition, 1985, Academic Press, Orlando, FL, USA.
  2. P. C. Hansen, Regularization tools: A Matlab package for analysis and solution of discrete ill-posed problems, Numerical Algorithms 6 (1998), 1-35.
  3. G. Lee, H. Fu, and J. L. Barlow, Fast high-resolution image reconstruction using Tikhonov regularization based total least squares, SIAM J. Sci. Comput. 35 (2013), no. 1, B275-B290. https://doi.org/10.1137/110850591
  4. S. Lu, S. V. Pereverzev, and U. Tautenhahn, Dual regularized total least squares and multi-parameter regularization, Comput. Methods Appl. Math. 8 (2008), no. 3, 253-262.
  5. S. Lu, S. V. Pereverzev, and U. Tautenhahn, Regularized total least squares: computational aspects and error bounds, SIAM J. Matrix Anal. Appl. 31 (2009), Issue 3.
  6. S. Lu, S. V. Pereverzev, and U. Tautenhahn, A model function method in regularized total least squares, Appl. Anal. 89 (2010), no. 11, 1693-1703. https://doi.org/10.1080/00036811.2010.492502
  7. J. Nocedal and S. J. Wright, Numerical Optimization, Springer-Verlag, Berlin, 2000.
  8. R. Renaut and H. Guo, Efficient algorithms for solution of regularized total least squares, SIAM J. Matrix Anal. Appl. 26 (2004), no. 2, 457-476. https://doi.org/10.1137/S0895479802419889