Multiclass Classification via Least Squares Support Vector Machine Regression

Title & Authors
Multiclass Classification via Least Squares Support Vector Machine Regression
Shim, Joo-Yong; Bae, Jong-Sig; Hwang, Chang-Ha;

Abstract
In this paper we propose a new method for solving multiclass problem with least squares support vector machine(LS-SVM) regression. This method implements one-against-all scheme which is as accurate as any other approach. We also propose cross validation(CV) method to select effectively the optimal values of hyper-parameters which affect the performance of the proposed multiclass method. Experimental results are then presented which indicate the performance of the proposed multiclass method.
Keywords
Classification;cross validation;least squares support vector machine;multiclass;one-against-all;support vector machine;
Language
English
Cited by
1.
Variable selection for multiclassi cation by LS-SVM,;

Journal of the Korean Data and Information Science Society, 2010. vol.21. 5, pp.959-965
2.
Fixed size LS-SVM for multiclassification problems of large data sets,;

Journal of the Korean Data and Information Science Society, 2010. vol.21. 3, pp.561-567
3.
커널머신을 이용한 대학의 컴퓨터교육 만족도 분석,피수영;박혜정;류경현;

Journal of the Korean Data and Information Science Society, 2011. vol.22. 5, pp.921-929
4.
퍼지의사결정법에 기반한 대학의 컴퓨터교육 만족도 분석,류경현;황병곤;

한국멀티미디어학회논문지, 2013. vol.16. 4, pp.502-509
1.
An analysis of satisfaction index on computer education of university based on Fuzzy Decision Making Method, Journal of Korea Multimedia Society, 2013, 16, 4, 502
References
1.
Allwein, E. L., Schapire, R. E. and Singer, Y. (2000). Reducing multiclass to binary: A unifying approach for margin classifiers, Journal of Machine Learning Research, 1,113-141

2.
Dietterich, T. G. and Bakiri, G. (1995). Solving multiclass learning problems via errorcorrecting output codes, Journal of Artificial Intelligence Research, 2, 263-286

3.
Kimeldorf, G. S. and Wahba, G. (1971). Some results on Tchebyche$\pm$an spline functions, Journal of Mathematical Analysis and Applications, 33, 82-95

4.
Lee, Y., Lin, Y. andWahba, G. (2001). Multicategory support vector machines, Technical Report 1043, In Proceeding of the 33rd Symposium on the Interface

5.
Mercer, J. (1909). Functions of positive and negative type and their connection with the theory of integral equations, Philosophical Transactions of the Royal Society of London, Series A, 209, 415-446

6.
Rifkin, R. and Klautau, A. (2004). In defense of one-vs-all classification, The Journal of Machine Learning Research, 5, 101-141

7.
Shim, J., Hong, D. H., Kim, D. H. and Hwang, C. (2007). Multinomial kernel logistic regression via bound optimization approach, The Korean Communications in Statistics, 14, 507-516

8.
Suykens, J. A. K. and Vandewalle, J. (1999a). Least square support vector machine classifiers, Neural Processing Letters, 9, 293-300

9.
Suykens, J. A. K. and Vandewalle, J. (1999b). Multiclass least squares support vector machines, In Proceeding of the International Joint Conference on Neural Networks, 900-903

10.
Suykens, J. A. K. (2001). Nonlinear modelling and support vector machines, In Proceeding of the IEEE Instrumentation and Measurement Technology Conference, 287-294

11.
Vapnik, V. N. (1995). The Nature of Statistical Learning Theory, Springer, New York

12.
Vapnik, V. N. (1998). Statistical Learning Theory, John Wieley & Sons, New York

13.
Weston, J. and Watkins, C. (1998). Multi-Class SVM, Technical Report, 98-104, Royal Holloway University of London