The Transactions of The Korean Institute of Electrical Engineers (전기학회논문지)

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지
DOI QR코드

DOI QR Code

Structural design of Optimized Interval Type-2 FCM Based RBFNN : Focused on Modeling and Pattern Classifier

최적화된 Interval Type-2 FCM based RBFNN 구조 설계 : 모델링과 패턴분류기를 중심으로

  • Kim, Eun-Hu (Dept. of Electrical Engineering, The University of Suwon) ;
  • Song, Chan-Seok (Dept. of Electrical Engineering, The University of Suwon) ;
  • Oh, Sung-Kwun (Dept. of Electrical Engineering, The University of Suwon) ;
  • Kim, Hyun-Ki (Dept. of Electrical Engineering, The University of Suwon)
  • Received : 2016.03.02
  • Accepted : 2017.02.21
  • Published : 2017.04.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose the structural design of Interval Type-2 FCM based RBFNN. Proposed model consists of three modules such as condition, conclusion and inference parts. In the condition part, Interval Type-2 FCM clustering which is extended from FCM clustering is used. In the conclusion part, the parameter coefficients of the consequence part are estimated through LSE(Least Square Estimation) and WLSE(Weighted Least Square Estimation). In the inference part, final model outputs are acquired by fuzzy inference method from linear combination of both polynomial and activation level obtained through Interval Type-2 FCM and acquired activation level through Interval Type-2 FCM. Additionally, The several parameters for the proposed model are identified by using differential evolution. Final model outputs obtained through benchmark data are shown and also compared with other already studied models' performance. The proposed algorithm is performed by using Iris and Vehicle data for pattern classification. For the validation of regression problem modeling performance, modeling experiments are carried out by using MPG and Boston Housing data.

Keywords

References

  1. L.A. Zadeh, "Fuzzy sets," Inform. and Control, Vol. 8, pp. 338-353, 1965. https://doi.org/10.1016/S0019-9958(65)90241-X
  2. J.M. Mendel, Uncertain Rule-based Fuzzy Logic System: Introduction and New Direction, Prentice-Hall, NJ, 2001.
  3. K. J. Park, Yong, K. Kim. S. K. Oh, "Design of Type-2 FCM-based Fuzzy Inference Systems and Its Optimization," Korean Institute of Electrical engineers, Vol. 60, No. 11, pp. 2157-2164, 2011. https://doi.org/10.5370/KIEE.2011.60.11.2157
  4. B.-I. Choi, F. C.-H. Rhee, "Interval type-2 fuzzy membership function generation methods for pattern recognition," Information Sciences, Vol. 179, No. 13, pp. 2102-2122, 2009. https://doi.org/10.1016/j.ins.2008.04.009
  5. S.-H. Yoo, S.-K. Oh, W. Pedrycz, "Optimized face recognition algorithm using radial basis function neural networks and its practical applications," Neural Networks, Vol. 69, pp. 111-125, 2015 https://doi.org/10.1016/j.neunet.2015.05.001
  6. P. Melin, O. Castillo "A Review on the Applications of Type-2 Fuzzy Logic in Classification and Pattern Recognition," Expert Systems with Applications, Vol. 40, No. 13, pp. 5413-5423, October 2013. https://doi.org/10.1016/j.eswa.2013.03.020
  7. S.-K. Oh, W.-D. Kim, W. Pedrycz, K. Seo, "Fuzzy Radial Basis Function Neural Networks with information granulation and its parallel genetic optimization," Fuzzy Sets and Systems, Vol. 237, pp. 96-117, 2014. https://doi.org/10.1016/j.fss.2013.08.011
  8. W.-D. Kim, S.-K. Oh, H.-K. Kim, "Structural Design of FCM-based Fuzzy Inference System: A Comparative Study of WLSE and LSE" Korean Institute of Electrical engineers, Vol. 59, pp. 981-989, 2010.
  9. H. H. Kim, "Interval Type-2 Fuzzy Approach to Gradient Based FCM," Han Yang University, Graduate master's thesis, 2009.
  10. W. D. Kim, "Optimized Type-1/Type-2 pRBF Neural Networks Architecture: Comparative Analysis & Methodological Design," The University of Suwon, Graduate master's thesis, 2011.
  11. R. Storn, and K. Price, "Differential Evolution - A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces," Journal of Global Optimization, Vol. 11, pp. 341-359, 1997. https://doi.org/10.1023/A:1008202821328
  12. W. Pedrycz, K. C. Kwak, "Linguistic models as a Framework of User-centric System Modeling," IEEE Trans. Syst. Man Cybem. A, Vol. 36, pp. 727-745, 2006. https://doi.org/10.1109/TSMCA.2005.855755
  13. S. B. Roh, S. K. Oh, W. pedrycz, "A Fuzzy Ensemble of Parallel Polynomial Neural Networks with Information Granules formed by Fuzzy Clustering", Knowledge-Based Syst., Vol. 23, pp. 202-219, 2010. https://doi.org/10.1016/j.knosys.2009.12.002
  14. R. Adamczak, W. Duda, and N. Jankowski "New Developments in the Feature Space Applications," 3rd Conference on Neural Networks, Kule, pp. 65-70, 1997.
  15. H. A. Abbass, "An Evolutionary Artificial Neural Networks Approach for Breast Cancer Diagnosis," Artif Intell Med, Vol. 25, No. 3, pp. 265-281, 2002. https://doi.org/10.1016/S0933-3657(02)00028-3
  16. I. Anagnostopoulos, I. Maglogiannis, "Neural networkbased Diagnostic and Prognostic Estimations in Breast Cancer Microscopic Instances," Medical & Biological Engineering & Computing Springer Publishers to appea Sep, Vol. 44, No. 9, pp. 773-784, 2006. https://doi.org/10.1007/s11517-006-0079-4
  17. M. E. Tipping, "The Relevance Vector Machine," Adv. Neural Inf. Pocess. Syst., Vol. 12, pp. 652-658, 2000.
  18. V. Vapnik, "The Nature of Statistical Learning Theory," New York: Springer-Verlag, 1995.
  19. R. O. Duda and P. E. Hart, "Pattern Classification and Science Analysis," New York : Wiley, 2002.
  20. S. Haykin, "Neural Networks- A comprehensive Foundation", Englwood Cliffs, NJ: Prentice-Hall, 1999.
  21. R. Parekh, J. H. Y and V. Honavar, "Constructive Neural-Network Learning Algorithms for Pattern Classification," IEEE, Vol. 11, No. 2, pp. 436-451, 2000.
  22. B. Krawczyk, M. Wozniak, and F. Herrera, "On the Usefulness of One-class Classifier Ensembles for Decomposition of Multi-class Problems," Pattern Recognition, Vol. 48, pp. 3969-3982, 2015. https://doi.org/10.1016/j.patcog.2015.06.001