The Transactions of The Korean Institute of Electrical Engineers (전기학회논문지)

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지
DOI QR코드

DOI QR Code

Comparative Analysis of Learning Methods of Fuzzy Clustering-based Neural Network Pattern Classifier

퍼지 클러스터링기반 신경회로망 패턴 분류기의 학습 방법 비교 분석

  • Kim, Eun-Hu (Dept. of Electrical Engineering, The University of Suwon) ;
  • Oh, Sung-Kwun (Dept. of Electrical Engineering, The University of Suwon) ;
  • Kim, Hyun-Ki (Dept. of Electrical Engineering, The University of Suwon)
  • Received : 2016.03.02
  • Accepted : 2016.07.18
  • Published : 2016.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we introduce a novel learning methodology of fuzzy clustering-based neural network pattern classifier. Fuzzy clustering-based neural network pattern classifier depicts the patterns of given classes using fuzzy rules and categorizes the patterns on unseen data through fuzzy rules. Least squares estimator(LSE) or weighted least squares estimator(WLSE) is typically used in order to estimate the coefficients of polynomial function, but this study proposes a novel coefficient estimate method which includes advantages of the existing methods. The premise part of fuzzy rule depicts input space as "If" clause of fuzzy rule through fuzzy c-means(FCM) clustering, while the consequent part of fuzzy rule denotes output space through polynomial function such as linear, quadratic and their coefficients are estimated by the proposed local least squares estimator(LLSE)-based learning. In order to evaluate the performance of the proposed pattern classifier, the variety of machine learning data sets are exploited in experiments and through the comparative analysis of performance, it provides that the proposed LLSE-based learning method is preferable when compared with the other learning methods conventionally used in previous literature.

Keywords

References

  1. R. R. Salakhutdinov and G. E. Hinton, "A better way to pretrain deep Boltzmann machines", Advances in Neural Information Processing 25, MIT Press, Cambridge, MA, pp. 1-9 2012.
  2. Y. LeCun, Y. Bengio, and G. E. Hinton, "Deep learning", Nature, Vol. 521, pp. 436-444, 2015. https://doi.org/10.1038/nature14539
  3. D. Broomhead, and D. Lowe, "Multivariable functional interpolation and adaptive networks", Complex Systems, Vol. 2, pp. 321-355, 1988.
  4. F. Schwenker, H. A. Kestler, and G. Palm, "Three learning phases for radial-basis-function networks", Neural Networks, Vol. 14, pp. 439-458, 2001. https://doi.org/10.1016/S0893-6080(01)00027-2
  5. S.-K. Oh, W.-D. Kim, W. Pedrycz, and S.-C. Joo, "Design of K-means Clustering-based Polynomial Radial Basis Function Neural Networks(pRBF NNs) Realized with the Aid of Particle Swarm Optimization and Differential Evolution", Neurocomputing, Vol. 78, No. 1, pp. 121-132, 2012. https://doi.org/10.1016/j.neucom.2011.06.031
  6. S.-K. Oh, W. Pedrycz, and H.-S. Park, "Multi-FNN Identification Based on HCM Clustering and Evolutionary Fuzzy Granulation", Simulation Modelling Practice and Theory, Vol. 11, No. 7-8, pp. 627-642, 2003. https://doi.org/10.1016/j.simpat.2003.09.001
  7. S.-K. Oh, W. Pedrycz, and H.-S. Park, "Implicit rulebased Fuzzy-Neural Networks Using The Identification Algorithm of GA Hybrid Scheme Based on Information Granulation", Advanced Engineering Informatics, Vol. 16, No. 4. pp. 247-263, 2002. https://doi.org/10.1016/S1474-0346(03)00016-8
  8. S.-B. Roh, S.-K. Oh, and W. Pedrycz, "Design of Fuzzy Radial Basis Function-based Polynomial Neural Networks", Fuzzy Sets and Systems, Vol. 185, No. 1, pp. 15-37, 2011. https://doi.org/10.1016/j.fss.2011.06.014
  9. S.-K. Oh, W.-D. Kim, W. Pedrycz, and B.-J. Park, "Polynomial-based Radial Basis Function Neural Networks (P-RBFNNs) Realized with the Aid of Particle Swarm Optimization," Fuzzy Sets and Systems, vol. 163, No. 1, pp. 54-77, January 2011. https://doi.org/10.1016/j.fss.2010.08.007
  10. J.-S. R. Jang, C.-T. Sun, and E. Mizutani, Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence, Prentic-Hall, Inc, New Jersey, 1997.
  11. S. P. Lloyd, "Least squares quantization in PCM," IEEE Transactions on Information Theory, Vol. 28, pp. 129-137, 1982. https://doi.org/10.1109/TIT.1982.1056489
  12. J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum Press, New York, 1981.
  13. J. C. Bezdek, and E. Robert, and F. William, "FCM: The Fuzzy C-Means Clustering Algorithm", Computers & Geosciences Vol. 10 No. 2-3, pp 191-203, 1984. https://doi.org/10.1016/0098-3004(84)90020-7
  14. J.-N. Choi, S.-K. Oh, and W. Pedrycz, "Identification of Fuzzy Relation Models Using Hierarchical Fair Competitionbased Parallel Genetic Algorithms and Information Granulation", Applied Mathematical Modelling, Vol. 33, No. 6, pp. 2791-2807, 2009. https://doi.org/10.1016/j.apm.2008.08.022
  15. S.-K. Oh, W.-D. Kim, and W. Pedrycz, "Design of Radial Basis Function Neural Network Classifier Realized with the Aid of Data Preprocessing Techniques: Design and Analysis", International Journal of General Systems, Vol. 45, No. 4, pp. 434-454, 2016. https://doi.org/10.1080/03081079.2015.1072523
  16. S.-K. Oh, and W.-D. Kim, W. Pedrycz, and K.-S. Seo, "Fuzzy Radial Basis Function Neural Networks with Information Granulation and Its Parallel Genetic Optimization," Fuzzy Sets and Systems, Vol. 237, pp. 96-117, 2014. https://doi.org/10.1016/j.fss.2013.08.011
  17. S.-B. Roh, S.-K. Oh, and W. Pedrycz, "A Fuzzy Ensemble of Parallel Polynomial Neural Networks with Information Granules Formed by Fuzzy Clustering", Knowledge-Based Systems, Vol. 23, No. 3, pp. 121-132, 2012.
  18. M. A. Tahir, A. Bouridane, and F. Kurugollu, "Simultaneous Feature Selection and Feature Weighting Using Hybrid Tabu Search/K-Nearest Neighbor Classifier," Pattern Recognition Letters, Vol. 28, No. 4, pp. 438-446, March 2007. https://doi.org/10.1016/j.patrec.2006.08.016