• Title/Summary/Keyword: Neural network optimization

Search Result 786, Processing Time 0.037 seconds

Optimal Learning of Fuzzy Neural Network Using Particle Swarm Optimization Algorithm

  • Kim, Dong-Hwa;Cho, Jae-Hoon
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.421-426
    • /
    • 2005
  • Fuzzy logic, neural network, fuzzy-neural network play an important as the key technology of linguistic modeling for intelligent control and decision making in complex systems. The fuzzy-neural network (FNN) learning represents one of the most effective algorithms to build such linguistic models. This paper proposes particle swarm optimization algorithm based optimal learning fuzzy-neural network (PSOA-FNN). The proposed learning scheme is the fuzzy-neural network structure which can handle linguistic knowledge as tuning membership function of fuzzy logic by particle swarm optimization algorithm. The learning algorithm of the PSOA-FNN is composed of two phases. The first phase is to find the initial membership functions of the fuzzy neural network model. In the second phase, particle swarm optimization algorithm is used for tuning of membership functions of the proposed model.

  • PDF

Time-Varying Two-Phase Optimization and its Application to neural Network Learning (시변 2상 최적화 및 이의 신경회로망 학습에의 응용)

  • Myeong, Hyeon;Kim, Jong-Hwan
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.31B no.7
    • /
    • pp.179-189
    • /
    • 1994
  • A two-phase neural network finds exact feasible solutions for a constrained optimization programming problem. The time-varying programming neural network is a modified steepest-gradient algorithm which solves time-varying optimization problems. In this paper, we propose a time-varying two-phase optimization neural network which incorporates the merits of the two-phase neural network and the time-varying neural network. The proposed algorithm is applied to system identification and function approximation using a multi-layer perceptron. Particularly training of a multi-layer perceptrion is regarded as a time-varying optimization problem. Our algorithm can also be applied to the case where the weights are constrained. Simulation results prove the proposed algorithm is efficient for solving various optimization problems.

  • PDF

Optimized Polynomial Neural Network Classifier Designed with the Aid of Space Search Simultaneous Tuning Strategy and Data Preprocessing Techniques

  • Huang, Wei;Oh, Sung-Kwun
    • Journal of Electrical Engineering and Technology
    • /
    • v.12 no.2
    • /
    • pp.911-917
    • /
    • 2017
  • There are generally three folds when developing neural network classifiers. They are as follows: 1) discriminant function; 2) lots of parameters in the design of classifier; and 3) high dimensional training data. Along with this viewpoint, we propose space search optimized polynomial neural network classifier (PNNC) with the aid of data preprocessing technique and simultaneous tuning strategy, which is a balance optimization strategy used in the design of PNNC when running space search optimization. Unlike the conventional probabilistic neural network classifier, the proposed neural network classifier adopts two type of polynomials for developing discriminant functions. The overall optimization of PNNC is realized with the aid of so-called structure optimization and parameter optimization with the use of simultaneous tuning strategy. Space search optimization algorithm is considered as a optimize vehicle to help the implement both structure and parameter optimization in the construction of PNNC. Furthermore, principal component analysis and linear discriminate analysis are selected as the data preprocessing techniques for PNNC. Experimental results show that the proposed neural network classifier obtains better performance in comparison with some other well-known classifiers in terms of accuracy classification rate.

Supervised Learning Artificial Neural Network Parameter Optimization and Activation Function Basic Training Method using Spreadsheets (스프레드시트를 활용한 지도학습 인공신경망 매개변수 최적화와 활성화함수 기초교육방법)

  • Hur, Kyeong
    • Journal of Practical Engineering Education
    • /
    • v.13 no.2
    • /
    • pp.233-242
    • /
    • 2021
  • In this paper, as a liberal arts course for non-majors, we proposed a supervised learning artificial neural network parameter optimization method and a basic education method for activation function to design a basic artificial neural network subject curriculum. For this, a method of finding a parameter optimization solution in a spreadsheet without programming was applied. Through this training method, you can focus on the basic principles of artificial neural network operation and implementation. And, it is possible to increase the interest and educational effect of non-majors through the visualized data of the spreadsheet. The proposed contents consisted of artificial neurons with sigmoid and ReLU activation functions, supervised learning data generation, supervised learning artificial neural network configuration and parameter optimization, supervised learning artificial neural network implementation and performance analysis using spreadsheets, and education satisfaction analysis. In this paper, considering the optimization of negative parameters for the sigmoid neural network and the ReLU neuron artificial neural network, we propose a training method for the four performance analysis results on the parameter optimization of the artificial neural network, and conduct a training satisfaction analysis.

JPEG quantization table design using R-D optimization and neural network (R-D 최적화와 신경 회로망을 이용한 JPEG 양자화 테이블 설계 방법)

  • Ka, Chung-Hee;Lee, Jong-Bum;Jeong, Gu-Min
    • Proceedings of the KIEE Conference
    • /
    • 2006.04a
    • /
    • pp.9-11
    • /
    • 2006
  • This paper presents JPEG quantization table design using RD optimization and neural network. Using R-D optimization, quantization table with good performance can be obtained. However, it is time-consuming and difficult to adopt to embedded systems. In this paper, a new quantization table design method is proposed using R-D optimization and neural network. Neural network learns the quantization table obtained from R-D optimization and produces a quantization table for the Images. The proposed system is applied to Yale face data. From the simulation results, it has been shown that the proposed codec has better performance than JPEG.

  • PDF

A Water-saving Irrigation Decision-making Model for Greenhouse Tomatoes based on Genetic Optimization T-S Fuzzy Neural Network

  • Chen, Zhili;Zhao, Chunjiang;Wu, Huarui;Miao, Yisheng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.6
    • /
    • pp.2925-2948
    • /
    • 2019
  • In order to improve the utilization of irrigation water resources of greenhouse tomatoes, a water-saving irrigation decision-making model based on genetic optimization T-S fuzzy neural network is proposed in this paper. The main work are as follows: Firstly, the traditional genetic algorithm is optimized by introducing the constraint operator and update operator of the Krill herd (KH) algorithm. Secondly, the weights and thresholds of T-S fuzzy neural network are optimized by using the improved genetic algorithm. Finally, on the basis of the real data set, the genetic optimization T-S fuzzy neural network is used to simulate and predict the irrigation volume for greenhouse tomatoes. The performance of the genetic algorithm improved T-S fuzzy neural network (GA-TSFNN), the traditional T-S fuzzy neural network algorithm (TSFNN), BP neural network algorithm(BPNN) and the genetic algorithm improved BP neural network algorithm (GA-BPNN) is compared by simulation. The simulation experiment results show that compared with the TSFNN, BPNN and the GA-BPNN, the error of the GA-TSFNN between the predicted value and the actual value of the irrigation volume is smaller, and the proposed method has a better prediction effect. This paper provides new ideas for the water-saving irrigation decision in greenhouse tomatoes.

Development of a Neural Network for Optimization and Its Application to Assembly Line Balancing

  • Hong, Dae-Sun;Ahn, Byoung-Jae;Shin, Joong-Ho;Chung, Won-Jee
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.587-591
    • /
    • 2003
  • This study develops a neural network for solving optimization problems. Hopfield network has been used for such problems, but it frequently gives abnormal solutions or non-optimal solutions. Moreover, it takes much time for solving a solution. To overcome such disadvantages, this study adopts a neural network whose output nodes change with a small value at every evolution, and the proposed neural network is applied to solve ALB (Assembly Line Balancing) problems . Given a precedence diagram and a required number of workstations, an ALB problem is solved while achieving even distribution of workload among workstations. Here, the workload variance is used as the index of workload deviation, and is reflected to an energy function. The simulation results show that the proposed neural network yields good results for solving ALB problems with high success rate and fast execution time.

  • PDF

Shape Optimization of Cut-Off in Multiblade Fan/Scroll System Using CFD and Neural Network (신경망 기법을 이용한 다익 홴/스크롤 시스템의 컷오프 최적화)

  • Han, S.Y.;Maeng, J.S.;Yoo, D.H.
    • Proceedings of the KSME Conference
    • /
    • 2001.11b
    • /
    • pp.365-370
    • /
    • 2001
  • In order to minimize unstable flow occurred at a multiblade fan/scroll system, optimal angle and shape of cut-off was determined by using two-dimensional turbulent fluid field analyses and neural network. The results of CFD analyses were used for learning as data of input and output of neural network. After learning neural network optimization process was accomplished for design variables, the angle and the shape of cut-off, in the design domain. As a result of optimization, the optimal angle and shape were obtained as 71 and 0.092 times the outer diameter of impeller, respectively, which are very similar values to previous studies. Finally, it was verified that the fluid field is very stable for optimal angle and shape of cut-off by two-dimensional CFD analysis.

  • PDF

Application of Ant Colony Optimization and Particle Swarm Optimization for Neural Network Model of Machining Process (절삭가공의 Neural Network 모델을 위한 ACO 및 PSO의 응용)

  • Oh, Soo-Cheol
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.18 no.9
    • /
    • pp.36-43
    • /
    • 2019
  • Turning, a main machining process, is a widespread process in metal cutting industries. Many researchers have investigated the effects of process parameters on the machining process. In the turning process, input variables including cutting speed, feed, and depth of cut are generally used. Surface roughness and electric current consumption are used as output variables in this study. We construct a simulation model for the turning process using a neural network, which predicts the output values based on input values. In the neural network, obtaining the appropriate set of weights, which is called training, is crucial. In general, back propagation (BP) is widely used for training. In this study, techniques such as ant colony optimization (ACO) and particle swarm optimization (PSO) as well as BP were used to obtain the weights in the neural network. Particularly, two combined techniques of ACO_BP and PSO_BP were utilized for training the neural network. Finally, the performances of the two techniques are compared with each other.

Prediction of Surface Roughness and Electric Current Consumption in Turning Operation using Neural Network with Back Propagation and Particle Swarm Optimization (BP와 PSO형 신경회로망을 이용한 선삭작업에서의 표면조도와 전류소모의 예측)

  • Punuhsingon, Charles S.C;Oh, Soo-Cheol
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.14 no.3
    • /
    • pp.65-73
    • /
    • 2015
  • This paper presents a method of predicting the machining parameters on the turning process of low carbon steel using a neural network with back propagation (BP) and particle swarm optimization (PSO). Cutting speed, feed rate, and depth of cut are used as input variables, while surface roughness and electric current consumption are used as output variables. The data from experiments are used to train the neural network that uses BP and PSO to update the weights in the neural network. After training, the neural network model is run using test data, and the results using BP and PSO are compared with each other.