The KIPS Transactions:PartB (정보처리학회논문지B)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

The Parallel ANN(Artificial Neural Network) Simulator using Mobile Agent

이동 에이전트를 이용한 병렬 인공신경망 시뮬레이터

  • 조용만 (해양센서네트워크시스템 기술연구센터) ;
  • 강태원 (강릉대학교 컴퓨터공학과)
  • Published : 2006.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

The objective of this paper is to implement parallel multi-layer ANN(Artificial Neural Network) simulator based on the mobile agent system which is executed in parallel in the virtual parallel distributed computing environment. The Multi-Layer Neural Network is classified by training session, training data layer, node, md weight in the parallelization-level. In this study, We have developed and evaluated the simulator with which it is feasible to parallel the ANN in the training session and training data parallelization because these have relatively few network traffic. In this results, we have verified that the performance of parallelization is high about 3.3 times in the training session and training data. The great significance of this paper is that the performance of ANN's execution on virtual parallel computer is similar to that of ANN's execution on existing super-computer. Therefore, we think that the virtual parallel computer can be considerably helpful in developing the neural network because it decreases the training time which needs extra-time.

이 논문은 이동 에이전트 시스템에 기반을 둔 가상의 병렬분산 컴퓨팅 환경에서 병렬로 수행되는 다층 인공신경망 시뮬레이터를 구현하는 것을 목적으로 한다. 다층 신경망은 학습세션, 학습데이터, 계층, 노드, 가중치 수준에서 병렬화가 이루어진다. 이 논문에서는 네트워크의 통신량이 상대적으로 적은 학습세션 및 학습데이터 수준의 병렬화가 가능한 신경망 시뮬레이터를 개발하고 평가하였다. 평가결과, 학습세션 병렬화와 학습데이터 병렬화 성능분석에서 약 3.3배의 학습 수행 성능 향상을 확인할 수 있었다. 가상의 병렬 컴퓨터에서 신경망을 병렬로 구현하여 기존의 전용병렬컴퓨터에서 수행한 신경망의 병렬처리와 비슷한 성능을 발휘한다는 점에서 이 논문의 의의가 크다고 할 수 있다. 따라서 가상의 병렬 컴퓨터를 이용하여 신경망을 개발하는데 있어서, 비교적 시간이 많이 소요되는 학습시간을 줄임으로서 신경망 개발에 상당한 도움을 줄 수 있다고 본다.

Keywords

References

  1. ？？Nikola B. Serbedzija, 'Simulating Artificial Neural Networks on Parallel Architectures', Computer, Vol. 29, No.3, 56-133, 1996 https://doi.org/10.1109/2.485893
  2. Pacheco P., Parallel Programming with MPI, Morgan Kaufmann, 1997
  3. William Gropp, Ewing Lusk, Anthony Skjellum, Using MPI: Portable Parallel Programming with the Message-Passing Interface, MIT Press, 1996
  4. Danny B.L., Mitsuru O., Programming and Deploying Java Mobile Agents with Agelets, Addison-Wesley, 1998
  5. Mario Tokoro, 'Agents: Towards a Society in Which Humans and Computers Cohabitate', in Distributed Software Agents and Applications, Springer, pp. 1-10., 1995
  6. T. R. Ioerger, R. A. Volz, J. Yen, 'Modeling Cooperative, Reactve Behaviors on the Battlefield Using Intelligent Agents.', Proceedings of the Ninth Conference on Computer Generated Forces (9th CGF) , pp. 13-23, 2000
  7. M. Miller, J. Yin, R.A. Volz, T.R. Ioerger, J. Yen, 'Training Teams with Collaborative Agents.', Proceedings of the Fifth International Conference on Intelligent Tutoring Systems, (ITS-2000, pp. 63-72, 2000
  8. O. Badawy,: A. Alrnotwaly, 'Combining neural network knowledge in a mobile collaborating multi-agent system' Electrical, Electronic and Computer Engineering, 2004. ICEEC apos; 04, 2004
  9. Manavendra Misra, 'Parallel Environments for Implementing Neural Networks', Neural Computing Surveys Vol. 1, 48-60, 1997. http://www.icsi.berkeley.edu/~jagota/NCS
  10. Gerd Kock and Nikola B. Serbedzija, 'Simulation of Artificial Neural Networks', SAMS, Vol. 27, 15-59, 1996
  11. Erich Schikuta, 'Structural Data Parallel Neural Network Simulation', 1997, http://citeseer.nj.nec.com/29242.html.
  12. X. Zhang, M. Mckenna, J. P. Mesrov and D. L. Waltz, 'The backpropagation algorithm on grid and hypercube architectures', Parallel Computing, Vol. 14, No. 3, 317-327, 1990 https://doi.org/10.1016/0167-8191(90)90084-M
  13. A. Zell, N. Mache, T. Sommer and T. Korb, 'Recent Developments of the SNNS Neural Network Simulator', Proc. Applications of Neural Networks Conference SPIE:, 708-719, 1991
  14. C. R. Rosenberg and G. Blelloch, 'An hnplementation of Network Learning on the CM', Proc. Joint Conference Artificial Intelligence, 329-340, 1987
  15. D. A. Pomerleau, G. L. Gusciora, D. S. Touretzxy and H. T. Kung, 'Neural Network Simulations at Warp Speed: How We Got 17 Million Connections per Second', Proc. IEEE lCNN. San Diego, 143-150, 1988 https://doi.org/10.1109/ICNN.1988.23922
  16. J-H. Chung, H. Yoon and S. R. Maeng, 'A Systolic array Exploiting the Inherent Parallelism of Artificial Neural Networks', Microprocessing and Microprogramming, Vol. 33, No.3, 145-159, 1991/92 https://doi.org/10.1016/0165-6074(92)90017-2
  17. R. Straub, D. Schwarz and E. Schoneburg, 'Simulation of backpropagation networks on transputers', Neurocomputing, Vol. 2, No. 5&6, 199-208, 1991
  18. D. Chess, C. Harrison, A. Kershenbaum, 'Mobile Agents: Are they a good idea?', IBM T,J Watson Research Center, 1995
  19. David Kotz, Robert S. Gray, 'Mobile Agents and the Future of the Internet', http://www.cs.dartmouth.edu, 1999
  20. N. Sundararajan, 'Parallel Architectures for Artificial Neural Networks: Paradigms and Implementations', wiley, pp. 49. 2002
  21. Oh-Kyoung Kwon , Jaegyoon Halun, Sangwan Kim, and jongsuk Lee , 'A Grid Resource Allocation System for Scientific Application: Grid Resource Allocation Services Package (GRASP)' Mardi Gras Conference, 2005