The KIPS Transactions:PartB (정보처리학회논문지B)

Korea Information Processing Society (한국정보처리학회)
권호 표지

Hybrid Learning Algorithm for Improving Performance of Regression Support Vector Machine

회귀용 Support Vector Machine의 성능개선을 위한 조합형 학습알고리즘

  • 조용현 (대구카톨릭대학교 공과대학 컴퓨터정보통신공학부) ;
  • 박창환 ((주)렉솔 아이엔씨) ;
  • 박용수 (대구 기능대학 및 포항1대학)
  • Published : 2001.10.01
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a hybrid learning algorithm combined momentum and kernel-adatron for improving the performance of regression support vector machine. The momentum is utilized for high-speed convergence by restraining the oscillation in the process of converging to the optimal solution, and the kernel-adatron algorithm is also utilized for the capability by working in nonlinear feature spaces and the simple implementation. The proposed algorithm has been applied to the 1-dimension and 2-dimension nonlinear function regression problems. The simulation results show that the proposed algorithm has better the learning speed and performance of the regression, in comparison with those quadratic programming and kernel-adatron algorithm.

본 논문에서는 회귀용 support vector machine의 성능 개선을 위한 모멘텀과 kernel-adatron 기법이 조합형 학습알고리즘을 제안하였다. 제안된 학습알고리즘은 supper vector machine의 학습기법인 기술기상승법에 발생하는 최적해로의 수렴에 따란 발진을 억제하여 그수렴속도를 좀 더 개선시키는 모멘텀의 장점과 비선형 특징공간에서의 동작과 구현의 용이성을 갖는 kernel-adatorn 알고리즘의 장점을 그대로 살린 것이다. 제안된 알고리즘의 support vector machine을 1차원과 2차원 비선형 함수 회귀에 적용하여 시뮬레이션한 결과, 학습속도에 있어서 2차 프로그래밍과 기존의 kernel-adaton 알고리즘보다 더 우수하고, 회귀성능면에서도 우수한 성능이 있음을 확인하였다.

Keywords

References

  1. V. Vanpnik, The Nature of Statistical Learning Theory, Springer Vergag, 1995
  2. M. O. Stitson, J. A. E. Weston, A. Gammerman, V. Vovk, and V. Vapnik, 'Theory of Support Vector Machines,' Technical report CSD-TR-96-17, Royal Holloway, Univ. of London, May, 1998
  3. E. E. Osuna, R. Freund, and F. Girosi, 'Simple Learning Algorithms for Training Support Vector Machines,' http://lara.enm.bris.ac.uk/cig/gzipped/KA-ieee.ps.gz
  4. E. E. Osuna, R. Freund, and F. Girosi, 'Training Support Vector Machines : An Application to Face Detection,' Proc.Computer Vision and Pattern Recognition'97, Pueto-Rico, June, 1997 https://doi.org/10.1109/CVPR.1997.609310
  5. J. C. Platt, Fast Training of Support Vector Machines Using Sequential Minimal Optimization, In Adavances in Kernels Methodes : Support Vector Learning, MIT Press, Cambridge, 1998
  6. A. J. Smola, and B. Scholkofp, 'A Tutorial on Support Vector Regression,' NeuroCOLT2 Technical Report, Neuro COLT, Oct. 1998
  7. C. Campbell and N. Christianini, 'Simple Learning Algorithms for Training Support Vector Machines,' Dept. of Engineering Mathematics Technical Report, Univ. of Bristol, 1998
  8. S. Gunn, 'Support Vector Machines for Clssification and Regression,' ISIS Technical Report, Univ. of Southhampton, May, 1998
  9. A. Smola, 'Regression Estimation with Support Vector Learning Machines,' Technische Universitat. Munchen Technical Report, Version 1.01., Dec. 1996
  10. V. Vapnik, The Nature of Ststistical Learn Theory, Springer Verlag, 1995
  11. V. Vapnik, S. Golowich, and A. Smola, Support vector method for function approximation, regression estimation, and siginal processing, Advances in Neural Information Processing Systems 9, pp.281-297, Cambridge, MIT Press, MA 1997