• Title/Summary/Keyword: GA-based polynomial neural network

Search Result 11, Processing Time 0.026 seconds

Modeling of Nonlinear SBR Process for Nitrogen Removal via GA-based Polynomial Neural Network (유전자 알고리즘 기반 다항식 뉴럴네트워크를 이용한 비선형 질소제거 SBR 공정의 모델링)

  • 김동원;박장현;이호식;박영환;박귀태
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.10 no.3
    • /
    • pp.280-285
    • /
    • 2004
  • This paper is concerned with the modeling and identification of sequencing batch reactor (SBR) via genetic algorithm based polynomial neural network (GA-based PNN). The model describes a biological SBR used in the wastewater treatment process fur nitrogen removal. A conventional polynomial neural network (PNN) is applied to construct a predictive model of SBR process fur nitrogen removal before. But the performances of PNN depend strongly on the number of input variables available to the model, the number of input variables and type (order) of the polynomials to each node. They must be fixed by the designer in advance before the architecture is constructed. So the trial and error method must go with heavy computation burden and low efficiency. To alleviate these problems, we propose GA-based PNN. The order of the polynomial, the number of input variables, and the optimum input variables are encoded as a chromosome and fitness of each chromosome is computed. Simulation results have shown that the complex SBR process can be modeled reasonably well by the present scheme with a much simpler structure compared with the conventional PNN model.

Genetically Optimized Self-Organizing Polynomial Neural Networks (진화론적 최적 자기구성 다항식 뉴럴 네트워크)

  • 박호성;박병준;장성환;오성권
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.53 no.1
    • /
    • pp.40-49
    • /
    • 2004
  • In this paper, we propose a new architecture of Genetic Algorithms(GAs)-based Self-Organizing Polynomial Neural Networks(SOPNN), discuss a comprehensive design methodology and carry out a series of numeric experiments. The conventional SOPNN is based on the extended Group Method of Data Handling(GMDH) method and utilized the polynomial order (viz. linear, quadratic, and modified quadratic) as well as the number of node inputs fixed (selected in advance by designer) at Polynomial Neurons (or nodes) located in each layer through a growth process of the network. Moreover it does not guarantee that the SOPNN generated through learning has the optimal network architecture. But the proposed GA-based SOPNN enable the architecture to be a structurally more optimized network, and to be much more flexible and preferable neural network than the conventional SOPNN. In order to generate the structurally optimized SOPNN, GA-based design procedure at each stage (layer) of SOPNN leads to the selection of preferred nodes (or PNs) with optimal parameters- such as the number of input variables, input variables, and the order of the polynomial-available within SOPNN. An aggregate performance index with a weighting factor is proposed in order to achieve a sound balance between approximation and generalization (predictive) abilities of the model. A detailed design procedure is discussed in detail. To evaluate the performance of the GA-based SOPNN, the model is experimented with using two time series data (gas furnace and NOx emission process data of gas turbine power plant). A comparative analysis shows that the proposed GA-based SOPNN is model with higher accuracy as well as more superb predictive capability than other intelligent models presented previously.

GA-based Feed-forward Self-organizing Neural Network Architecture and Its Applications for Multi-variable Nonlinear Process Systems

  • Oh, Sung-Kwun;Park, Ho-Sung;Jeong, Chang-Won;Joo, Su-Chong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.3 no.3
    • /
    • pp.309-330
    • /
    • 2009
  • In this paper, we introduce the architecture of Genetic Algorithm(GA) based Feed-forward Polynomial Neural Networks(PNNs) and discuss a comprehensive design methodology. A conventional PNN consists of Polynomial Neurons, or nodes, located in several layers through a network growth process. In order to generate structurally optimized PNNs, a GA-based design procedure for each layer of the PNN leads to the selection of preferred nodes(PNs) with optimal parameters available within the PNN. To evaluate the performance of the GA-based PNN, experiments are done on a model by applying Medical Imaging System(MIS) data to a multi-variable software process. A comparative analysis shows that the proposed GA-based PNN is modeled with higher accuracy and more superb predictive capability than previously presented intelligent models.

A New Design Approach for Optimization of GA-based SOPNN (GA 기반 자기구성 다항식 뉴럴 네트워크의 최적화를 위한 새로운 설계 방법)

  • Park, Ho-Sung;Park, Byoung-Jun;Park, Keon-Jun;Oh, Sung-Kwun
    • Proceedings of the KIEE Conference
    • /
    • 2003.07d
    • /
    • pp.2627-2629
    • /
    • 2003
  • In this paper, we propose a new architecture of Genetic Algorithms(GAs)-based Self-Organizing Polynomial Neural Networks(SOPNN). The conventional SOPNN is based on the extended Group Method of Data Handling(GMDH) method and utilized the polynomial order (viz. linear, quadratic, and modified quadratic) as well as the number of node inputs fixed (selected in advance by designer) at Polynomial Neurons (or nodes) located in each layer through a growth process of the network. Moreover it does not guarantee that the SOPNN generated through learning has the optimal network architecture. But the proposed GA-based SOPNN enable the architecture to be a structurally more optimized networks, and to be much more flexible and preferable neural network than the conventional SOPNN. An aggregate performance index with a weighting factor is proposed in order to achieve a sound balance between approximation and generalization (predictive) abilities of the model. To evaluate the performance of the GA-based SOPNN, the model is experimented with using nonlinear system data.

  • PDF

Design of Advanced Self-Organizing Fuzzy Polynomial Neural Networks Based on FPN by Evolutionary Algorithms (진화론적 알고리즘에 의한 퍼지 다항식 뉴론 기반 고급 자기구성 퍼지 다항식 뉴럴 네트워크 구조 설계)

  • Park, Ho-Sung;Oh, Sung-Kwun;Ahn, Tea-Chon
    • Proceedings of the KIEE Conference
    • /
    • 2005.10b
    • /
    • pp.322-324
    • /
    • 2005
  • In this paper, we introduce the advanced Self-Organizing Fuzzy Polynomial Neural Network based on optimized FPN by evolutionary algorithm and discuss its comprehensive design methodology involving mechanisms of genetic optimization, especially genetic algorithms (GAs). The proposed model gives rise to a structurally and parametrically optimized network through an optimal parameters design available within Fuzzy Polynomial Neuron(FPN) by means of GA. Through the consecutive process of such structural and parametric optimization, an optimized and flexible the proposed model is generated in a dynamic fashion. The performance of the proposed model is quantified through experimentation that exploits standard data already used in fuzzy modeling. These results reveal superiority of the proposed networks over the existing fuzzy and neural models.

  • PDF

A Study on GA-based Optimized Polynomial Neural Networks and Its Application to Nonlinear Process (유전자 알고리즘 기반 최적 다항식 뉴럴네트워크 연구 및 비선형 공정으로의 응용)

  • Kim Wan-Su;Lee In-Tae;Oh Sung-Kwun;Kim Hyun-Ki
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.15 no.7
    • /
    • pp.846-851
    • /
    • 2005
  • In this paper, we propose Genetic Algorithms(GAs)-based Optimized Polynomial Neural Networks(PNN). The proposed algorithm is based on Group Method of Data Handling(GMDH) method and its structure is similar to feedforward Neural Networks. But the structure of PNN is not fixed like in conventional neural networks and can be generated in a dynamic manner. As each node of PNN structure, we use several types of high-order polynomial such as linear, quadratic and modified quadratic, and it is connected as various kinds of multi-variable inputs. The conventional PNN depends on the experience of a designer that select the number of input variables, input variable and polynomial type. Therefore it is very difficult to organize optimized network. The proposed algorithm leads to identify and select the number of input variables, input variable and polynomial type by using Genetic Algorithms(GAs). The aggregate performance index with weighting factor is proposed as well. The study is illustrated with tile NOx omission process data of gas turbine power plant for application to nonlinear process. In the sequel the proposed model shows not only superb predictability but also high accuracy in comparison to the existing intelligent models.

A New Architecture of Genetically Optimized Self-Organizing Fuzzy Polynomial Neural Networks by Means of Information Granulation

  • Park, Ho-Sung;Oh, Sung-Kwun;Ahn, Tae-Chon
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.1505-1509
    • /
    • 2005
  • This paper introduces a new architecture of genetically optimized self-organizing fuzzy polynomial neural networks by means of information granulation. The conventional SOFPNNs developed so far are based on mechanisms of self-organization and evolutionary optimization. The augmented genetically optimized SOFPNN using Information Granulation (namely IG_gSOFPNN) results in a structurally and parametrically optimized model and comes with a higher level of flexibility in comparison to the one we encounter in the conventional FPNN. With the aid of the information granulation, we determine the initial location (apexes) of membership functions and initial values of polynomial function being used in the premised and consequence part of the fuzzy rules respectively. The GA-based design procedure being applied at each layer of genetically optimized self-organizing fuzzy polynomial neural networks leads to the selection of preferred nodes with specific local characteristics (such as the number of input variables, the order of the polynomial, a collection of the specific subset of input variables, and the number of membership function) available within the network. To evaluate the performance of the IG_gSOFPNN, the model is experimented with using gas furnace process data. A comparative analysis shows that the proposed IG_gSOFPNN is model with higher accuracy as well as more superb predictive capability than intelligent models presented previously.

  • PDF

Self-Organizing Polynomial Neural Networks Based on Genetically Optimized Multi-Layer Perceptron Architecture

  • Park, Ho-Sung;Park, Byoung-Jun;Kim, Hyun-Ki;Oh, Sung-Kwun
    • International Journal of Control, Automation, and Systems
    • /
    • v.2 no.4
    • /
    • pp.423-434
    • /
    • 2004
  • In this paper, we introduce a new topology of Self-Organizing Polynomial Neural Networks (SOPNN) based on genetically optimized Multi-Layer Perceptron (MLP) and discuss its comprehensive design methodology involving mechanisms of genetic optimization. Let us recall that the design of the 'conventional' SOPNN uses the extended Group Method of Data Handling (GMDH) technique to exploit polynomials as well as to consider a fixed number of input nodes at polynomial neurons (or nodes) located in each layer. However, this design process does not guarantee that the conventional SOPNN generated through learning results in optimal network architecture. The design procedure applied in the construction of each layer of the SOPNN deals with its structural optimization involving the selection of preferred nodes (or PNs) with specific local characteristics (such as the number of input variables, the order of the polynomials, and input variables) and addresses specific aspects of parametric optimization. An aggregate performance index with a weighting factor is proposed in order to achieve a sound balance between the approximation and generalization (predictive) abilities of the model. To evaluate the performance of the GA-based SOPNN, the model is experimented using pH neutralization process data as well as sewage treatment process data. A comparative analysis indicates that the proposed SOPNN is the model having higher accuracy as well as more superb predictive capability than other intelligent models presented previously.reviously.

Genetic Algorithms based Optimal Polynomial Neural Network and Its application to Nonlinear Process (유전자 알고리즘 기반 최적 다항식 뉴럴네트워크 및 비선형 공정으로의 응용)

  • Kim Wan-Su;Oh Sung-Kwun;Kim Hyun-Ki
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2005.11a
    • /
    • pp.191-194
    • /
    • 2005
  • 본 논문은 최적 탐색 알고리즘인 유전자 알고리즘을 이용하여 다항식 뉴럴네트워크(Polynomial Neural Networks : PNN)의 최적 설계가 그 목적이다. 기존의 다항식 뉴럴네트워크는 확장된 GMDH(Group Method of Data Handling) 방법에 기반을 두며, 네트워크의 성장과정을 통하여 각 층의 다항식뉴런(혹은 노드)에서 고정된 (설계자에 의해 미리 선택된) 노드 입력들의 수뿐만 아니라 다항식 차수(1차, 2차, 그리고 수정된 2차식)를 이용하였다. 더구나, 그 방법은 학습을 통해 생성된 PNN이 최적 네트워크 구조를 가진다는 것을 보증하지 못한다. 그러나, 제안된 GA-based PW 모델은 다음의 파라미터들- 즉 입력변수의 수, 입력변수, 및 다항식 차수-을 유전자 알고리즘을 이용하여 선택 동조함으로써 그 구조를 구조적으로 더 최적화된 네트워크가 되도록 하고, 기존의 PNN보다 훨씬 더 유연하고, 선호된 뉴럴 네트워크가 되도록 한다. 하중계수를 가진 합성성능지수가 그 모델의 근사화 및 일반화(예측) 능력 사이의 상호 균형을 얻기 위해 제안된다. GA-based PNN의 성능을 평가하기 위해 그 모델은 가스 터빈발전소의 NOx 배출 공정 데이터로 실험된다. 비교해석은 제안된 GA-based PNN이 앞서 나타난 다른 지능모델보다 더 우수한 예측능력뿐만 아니라 높은 정확성을 가진 모델임을 보인다.

  • PDF

A Neuro-Fuzzy Approach to Integration and Control of Industrial Processes:Part I

  • Kim, Sung-Shin
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.8 no.6
    • /
    • pp.58-69
    • /
    • 1998
  • This paper introduces a novel neuro-fuzzy system based on the polynomial fuzzy neural network(PFNN) architecture. The PFNN consists of a set of if-then rules with appropriate membership functions whose parameters are optimized via a hybrid genetic algorithm. A polynomial neural network is employed in the defuzzification scheme to improve output performance and to select appropriate rules. A performance criterion for model selection, based on the Group Method of DAta Handling is defined to overcome the overfitting problem in the modeling procedure. The hybrid genetic optimization method, which combines a genetic algorithm and the Simplex method, is developed to increase performance even if the length of a chromosome is reduced. A novel coding scheme is presented to describe fuzzy systems for a dynamic search rang in th GA. For a performance assessment of the PFNN inference system, three well-known problems are used for comparison with other methods. The results of these comparisons show that the PFNN inference system outperforms the other methods while it exhibits exceptional robustness characteristics.

  • PDF