JOURNAL BROWSE
Search
Advanced SearchSearch Tips
Pseudoinverse Matrix Decomposition Based Incremental Extreme Learning Machine with Growth of Hidden Nodes
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Pseudoinverse Matrix Decomposition Based Incremental Extreme Learning Machine with Growth of Hidden Nodes
Kassani, Peyman Hosseinzadeh; Kim, Euntai;
  PDF(new window)
 Abstract
The proposal of this study is a fast version of the conventional extreme learning machine (ELM), called pseudoinverse matrix decomposition based incremental ELM (PDI-ELM). One of the main problems in ELM is to determine the number of hidden nodes. In this study, the number of hidden nodes is automatically determined. The proposed model is an incremental version of ELM which adds neurons with the goal of minimization the error of the ELM network. To speed up the model the information of pseudoinverse from previous step is taken into account in the current iteration. To show the ability of the PDI-ELM, it is applied to few benchmark classification datasets in the University of California Irvine (UCI) repository. Compared to ELM learner and two other versions of incremental ELM, the proposed PDI-ELM is faster.
 Keywords
ELM;Pseudoinverse matrix;Hidden nodes;Least square estimation;Speed up;
 Language
English
 Cited by
 References
1.
N. Y. Liang, G. B. Huang, P. Saratchandran, and N. Sundararajan, "A fast and accurate online sequential learning algorithm for feedforward networks," IEEE Transactions on Neural Networks, vol. 17, no. 6, pp. 1411-1423, 2006. http://dx.doi.org/10.1109/TNN.2006.880583 crossref(new window)

2.
G. B. Huang, H. Zhou, X. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification," IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 42, no. 2, pp. 513-529, 2012. http://dx.doi.org/10.1109/TSMCB.2011.2168604 crossref(new window)

3.
Z. Bai, G. B. Huang, D. Wang, H. Wang, and M. B. Westover, "Sparse extreme learning machine for classification," IEEE Transactions on Cybernetics, vol. 44, no. 10, pp. 1858-1870, 2014. http://dx.doi.org/10.1109/TCYB.2014.2298235 crossref(new window)

4.
J. Luo, C. M. Vong, and P. K. Wong, "Sparse Bayesian extreme learning machine for multi-classification," IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 4, pp. 836-843, 2014. http://dx.doi.org/10.1109/TNNLS.2013.2281839 crossref(new window)

5.
W. Zong, G. B. Huang, and Y. Chen, "Weighted extreme learning machine for imbalance learning," Neurocomputing, vol. 101, pp. 229-242, 2013. http://dx.doi.org/10.1016/j.neucom.2012.08.010 crossref(new window)

6.
G. B. Huang, Q. Y. Zhu, and C. K. Siew, "Extreme learning machine: a new learning scheme of feedforward neural networks," in Proceedings of IEEE International Joint Conference on Neural Networks, Budapest, Hungary, 2004, pp. 985-990. http://dx.doi.org/10.1109/IJCNN.2004.1380068 crossref(new window)

7.
Y. Miche, A. Sorjamaa, P. Bas, O. Simula, C. Jutten, and A. Lendasse, "OP-ELM: optimally pruned extreme learning machine," IEEE Transactions on Neural Networks, vol. 21, no. 1, pp. 158-162, 2010. http://dx.doi.org/10.1109/TNN.2009.2036259 crossref(new window)

8.
X. Bi, X. Zhao, G. Wang, P. Zhang, and C. Wang, "Distributed extreme learning machine with kernels based on MapReduce," Neurocomputing, vol. 149, pp. 456-463, 2015. http://dx.doi.org/10.1016/j.neucom.2014.01.070 crossref(new window)

9.
G. Huang, S. Song, J. N. D. Gupta, and C. Wu, "Semisupervised and unsupervised extreme learning machines," IEEE Transactions on Cybernetics, vol. 44, no. 12, pp. 2405-2417, 2014. http://dx.doi.org/10.1109/TCYB.2014.2307349 crossref(new window)

10.
G. B. Huang, L. Chen, and C. K. Siew, "Universal approximation using incremental constructive feedforward networks with random hidden nodes," IEEE Transactions on Neural Networks, vol. 17, no. 4, pp. 879-892, 2006. http://dx.doi.org/10.1109/TNN.2006.875977 crossref(new window)

11.
G. B. Huang, Q. Y. Zhu, and C. K. Siew, "Extreme learning machine: theory and applications," Neurocomputing, vol. 70, no. 1-3, pp. 489-501, 2006. http://dx.doi.org/10.1016/j.neucom.2005.12.126 crossref(new window)

12.
G. Feng, G. B. Huang, Q. Lin, and R. Gay, "Error minimized extreme learning machine with growth of hidden nodes and incremental learning," IEEE Transactions on Neural Networks, vol. 20, no. 8, pp. 1352-1357, 2009. http://dx.doi.org/10.1109/TNN.2009.2024147 crossref(new window)

13.
Y. Ye and Y. Qin, "QR factorization based incremental extreme learning machine with growth of hidden nodes," Pattern Recognition Letters, vol. 65, pp. 177-183, 2015. http://dx.doi.org/10.1016/j.patrec.2015.07.031 crossref(new window)

14.
T. N. E. Greville, "Some applications of the pseudoinverse of a matrix," SIAM Review, vol. 2, no. 1, pp. 15-22, 1960. http://dx.doi.org/10.1137/1002004 crossref(new window)