The Transactions of The Korean Institute of Electrical Engineers (전기학회논문지)

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지
DOI QR코드

DOI QR Code

Evolutionary Design of Radial Basis Function-based Polynomial Neural Network with the aid of Information Granulation

정보 입자화를 통한 방사형 기저 함수 기반 다항식 신경 회로망의 진화론적 설계

  • Received : 2010.04.16
  • Accepted : 2011.01.12
  • Published : 2011.04.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we introduce a new topology of Radial Basis Function-based Polynomial Neural Networks (RPNN) that is based on a genetically optimized multi-layer perceptron with Radial Polynomial Neurons (RPNs). This study offers a comprehensive design methodology involving mechanisms of optimization algorithms, especially Fuzzy C-Means (FCM) clustering method and Particle Swarm Optimization (PSO) algorithms. In contrast to the typical architectures encountered in Polynomial Neural Networks (PNNs), our main objective is to develop a design strategy of RPNNs as follows : (a) The architecture of the proposed network consists of Radial Polynomial Neurons (RPNs). In here, the RPN is fully reflective of the structure encountered in numeric data which are granulated with the aid of Fuzzy C-Means (FCM) clustering method. The RPN dwells on the concepts of a collection of radial basis function and the function-based nonlinear (polynomial) processing. (b) The PSO-based design procedure being applied at each layer of RPNN leads to the selection of preferred nodes of the network (RPNs) whose local characteristics (such as the number of input variables, a collection of the specific subset of input variables, the order of the polynomial, and the number of clusters as well as a fuzzification coefficient in the FCM clustering) can be easily adjusted. The performance of the RPNN is quantified through the experimentation where we use a number of modeling benchmarks - NOx emission process data of gas turbine power plant and learning machine data(Automobile Miles Per Gallon Data) already experimented with in fuzzy or neurofuzzy modeling. A comparative analysis reveals that the proposed RPNN exhibits higher accuracy and superb predictive capability in comparison to some previous models available in the literature.

Keywords

References

  1. W. Pedrycz and J. F. Peters, Computational Intelligence and Software Engineering, World Scientific, Singapore, 1998.
  2. W. Pedrycz, G. Vukovich, "Granular neural networks," Neurocomputing, Vol. 36, pp. 205-224, 2001. https://doi.org/10.1016/S0925-2312(00)00342-8
  3. T. Takagi and M. Sugeno, "Fuzzy Identification of Systems and its Application to Modeling and Control," IEEE Trans. on Systems Man and Cybernetics, Vol. 15, pp. 116-132, 1985.
  4. Y. Tan, J. Wang, and J. M. Zurada, "Nonlinear blind source separation using a radial basis function network," IEEE Trans. Neural Networks, Vol. 12, No. 1, pp. 124-134, 2001. https://doi.org/10.1109/72.896801
  5. M. Han and J. Xi, "Efficient clustering of radial basis perceptron neural network for pattern recognition," Pattern Recognition, Vol. 37, pp. 2059-2067, 2004. https://doi.org/10.1016/j.patcog.2004.02.014
  6. J. M. Vilaplana, J. L. P. Molina, and J. L. Coronada, "Hyper RBF model for accurate reaching in redundant robotic systems," Neurocomputing, Vol. 61, pp. 495-501, 2004. https://doi.org/10.1016/j.neucom.2004.06.006
  7. M. L. Kothari, S. Madnani, and R. Segal, "Orthogonal Least Square Learning Algorithm Based Radial Basis Function Network Adaptive Power System Stabilizer," Proceeding of IEEE SMC, Vol. 1, pp. 542-547, 1997.
  8. A. Staiano. J. Tagliaferri, W. Pedrycz, " Improving RBF networks performance in regression tasks by means of a supervised fuzzy clustering Automatic structure and parameter," Neurocomputing, Vol. 69, pp. 1570-1581, 2006. https://doi.org/10.1016/j.neucom.2005.06.014
  9. N. B. Karayiannis, "Reformulated radial basis neural networks trained by gradient descent," IEEE Trans. Neural Networks, Vol. 10, No. 3, pp. 657-671, 1999. https://doi.org/10.1109/72.761725
  10. S. M. Loone and G. Irwin, "improving neural network training solutions using regularisation," Neurocomputing, Vol. 37, pp. 71-90, 2001. https://doi.org/10.1016/S0925-2312(00)00314-3
  11. W. Pedrycz, H. S. Park, S. K. Oh, "A granular-oriented development of functional radial basis function neural networks," Neurocomputing, Vol. 72, No. 1-3, pp. 420-435, 2008. https://doi.org/10.1016/j.neucom.2007.12.016
  12. S. K. Oh, W. Pedrycz, S. B. Roh, "Hybrid fuzzy set-based polynomial neural networks and their development with the aid of genetic optimization and information granulation," Applied Soft Computing, Vol. 9, No. 3, pp. 1068-1089, 2009. https://doi.org/10.1016/j.asoc.2009.02.007
  13. S. K. Oh, W. Pedrycz, H. S. Park, "Genetically Optimized Fuzzy Polynomial Neural Networks," IEEE Trans. on Fuzzy Systems, Vol. 14, No. 1, pp. 125-144, 2006. https://doi.org/10.1109/TFUZZ.2005.861620
  14. J. Kennedy and R. Eberhart, "Particle Swarm Optimization," Proc. of IEEE International Conference on Neural Networks, Vol. 4, pp. 1942-1948, 1995.
  15. B. J. Park, S. K. Oh, Y. S. Kim, T. C. Ahn, "Comparative Study on Dimensionality and Characteristic of PSO," Journal of Control, Automation and Systems Engineering, Vol. 12, No. 4, pp. 328-338, 2006. https://doi.org/10.5302/J.ICROS.2006.12.4.328
  16. S. K. Oh, "A study on the development of intelligent models and simulator concerning the pattern of an air pollutant emission in a thermal power plant," Technical Report, Korea Energy Management Corporation, 2004.
  17. S. K. Oh, W. Pedrycz, H. S. Park, "Hybrid Identification in fuzzy-neural networks," Fuzzy Set Syst. Vol. 138, No. 3, pp. 399-426, 2003. https://doi.org/10.1016/S0165-0114(02)00441-4
  18. S. K. Oh, W. Pedrycz, H. S. Park, "Rule-based multi-FNN Identification with the aid of evolutionary fuzzy granulation," J. Knowledge-Based Syst, Vol. 17, No. 1, pp. 1-13, 2004. https://doi.org/10.1016/S0950-7051(03)00047-9
  19. S. K. Oh, W. Pedrycz and H. S. Park, "Hybrid Identification in Fuzzy-Neural Networks," Fuzzy Sets and Systems, Vol. 138, No. 2, pp. 399-426, 2003. https://doi.org/10.1016/S0165-0114(02)00441-4
  20. W. Pedrycz, K. C. Kwak, "Linguistic models as a framework of user-centric system modeling," IEEE Trans. SMC-A, Vol. 36, No. 4, pp. 727-745, 2006.
  21. W. Pedrycz, K. C. Kwak, "The Development of Incremental Models," IEEE Trans. Fuzzy Systems, Vol. 15, No. 3, pp. 507-518, 2007. https://doi.org/10.1109/TFUZZ.2006.889967