Performance Improvement with Determination of Coefficients by Energy Function Analysis in Hopfield Neural Networks

에너지 함수 분석에 의한 홉필드 신경망의 계수 결정 및 성능 개선

  • 박지연 (관동대학교 정보기술공학부)
  • Published : 2001.04.01

Abstract

홉필드 신경망은 병렬 연산 및 일반적 응용성을 가진 장점으로 인해 여러 분야의 조합형 최적화 문제에 도입하기 위해 많은 연구가 이루어져 왔다. 그러나, 다양한 응용분야에서의 성공적 적용 사례에도 불구하고, 에너지 함수의 계수를 결정하는 실용적인 방법의 부재로 인해 대부분의 경우 실험에 의해 얻어진 값에 의존해야 하는 단점이 있다. 본 논문에서는 문제에 대한 해의 유효성을 만족하면서 모델이 최적에 근접할 수 있도록 에너지 수위를 직접 이용하여 계수를 결정하는 정형적인 기법을 제안한다. 제안한 방식은 기존의 계수 결정법과 함께 시뮬레이션을 수행하였으며, 그 결과는 제안한 접근방식이 유효함을 보여준다.

Keywords

References

  1. Abe, S., 'Theories on the Hopfield Neural Networks,' International Joint Conference on Neural Networks, Vol.1, pp.557-564, 1989 https://doi.org/10.1109/IJCNN.1989.118633
  2. Aiyer, S. V. B., Niranjan, M. and Fallside, F., 'A Theoretical Investigation into the Performance of the Hopfield Model,' IEEE Trans. Neural Networks, Vol.1, No.2, pp.204-215, 1990 https://doi.org/10.1109/72.80232
  3. Bizzarri, A. R., 'Convergence Properties of a Modified Hopfield-Tank Model,' Biological Cybernetics, Vol.64, pp.293-300, 1991 https://doi.org/10.1007/BF00199592
  4. Brandt, R. D., Wang, Y., Laub, A. J. and Mitra, S. K., 'Alternative Networks for Solving the Traveling Salesman Problem and List-Matching Problem,' IEEE International Conference on Neural Networks, Vol.2, pp.333-340, 1988 https://doi.org/10.1109/ICNN.1988.23945
  5. Cichochki, A. and Unbehauen, R., 'Neural Networks for Optimization and Signal Processing,' John Wiley & Sons, 1993
  6. Garey, M. R. and Johnson, D. S., 'Computer and Intractability : A Guide to the Theory of Np-Completeness,' Freeman, San Fransisco, 1979
  7. Hedge, S. U., Sweet, J. L., and Levy, W. B., 'Determination of Parameters in a Hopfield Tank Computational Network,' International Conference on Neural networks, Vol.2, pp.291, 1988 https://doi.org/10.1109/ICNN.1988.23941
  8. Hopfield, J. J., and Tank, D. W. 'Neural Computation of Decisions in Optimization Problems,' Biological Cybernetics, Vol.52, pp. 141-152, 1985 https://doi.org/10.1007/BF00339943
  9. Jagota, A.'Approximating Maximum Cique with a Hopfield Network.' IEEE Transactions on Neural Networks, Vol.6, No.3, pp.724-735, 1995 https://doi.org/10.1109/72.377977
  10. Kamgar-Parsi, B., and Kamgar-Parsi, B. 'On Problem Solving with Hopfield neural Networks,' Biological Cybernetics, Vol.62, pp. 415-423, 1990 https://doi.org/10.1007/BF00197648
  11. Lin, S., Kernighan, B. W. 'An Effective Heuristic Algorithm for the Traveling Salesman Problem,' Operations Research, Vol.21, pp.498-516, 1973
  12. Lin, W., Delgado-Frias, J. G., Pechanek, G. G., and Vassiliadis, S. 'Impact of Energy Function on a Neural Network Model for Optimization Problems,' IEEE International Conference on Neural Networks, Vol.7, pp.4518-4523, 1994 https://doi.org/10.1109/ICNN.1994.375001
  13. Matsuda, S. 'Theoretical Characterizations of Possibilities and Impossibilities of Hopfield Neural Networks in Solving Combinatorial Optimization Problems,' IEEE International Conference on Neural Networks, Vol.7, pp.4563-4566, 1994 https://doi.org/10.1109/ICNN.1994.375009
  14. Paielli, R.A. 'Simulation tests of the optimization method of Hopfield and Tank using neural networks,' NASA Technical Memorandum 101047, 1988
  15. Shirai, H., Ishigame, A., Kawamoto, S., and Taniguchi, T., 'A Solution of Combinatorial Optimization Problem by Uniting genetic Algorithms with Hopfield's Model,' IEEE International Conference on Neural Networks, Vol.7, pp.4704-4709, 1994 https://doi.org/10.1109/ICNN.1994.375036
  16. Szu, H. H., 'Fast TSP Algorithm Based on Binary Neuron Output and Alalog Neuron Input Using the Zero-Diagonal Interconnect Matrix and Necessary and Sufficient Constraints of the Permutation Matrix,' IEEE International Conference on Neural Networks, Vol.2, pp.259-265, 1988 https://doi.org/10.1109/ICNN.1988.23937
  17. Takefuji, Y. 'Neural Network Parallel Computing,' Kluwer Academic Publishers, 1992
  18. Xu, X. and Tsai, W. T. 'Effective Neural Algorithms for the Traveling Salesman Problem,' Neural Networks, Vol.4, pp.193-205, 1991 https://doi.org/10.1016/0893-6080(91)90004-O
  19. Wilson, G. V., and Pawley, G. S., 'On the Satbility of the Traveling Saiesman Problem Algorithm of Hopfield and Tank,' Biological Cybernetics, Vol.58, pp.63-70, 1988 https://doi.org/10.1007/BF00363956
  20. Zak, M. 'Terminal Attractors for Addressable Memory in Neural Networks,' Physics Letter A. Vol.133, pp.18-12, 1988 https://doi.org/10.1016/0375-9601(88)90728-1