Development of the Dynamic Host Management Scheme for Parallel/Distributed Processing on the Web

웹 환경에서의 병렬/분산 처리를 위한 동적 호스트 관리 기법의 개발

  • 송은하 (원광대학교 컴퓨터공학과) ;
  • 정영식 (원광대학교 컴퓨터및정보통신공학부)
  • Published : 2002.06.01

Abstract

The parallel/distributed processing with a lot of the idle hosts on the web has the high coot-performance ratio for large-scale applications. It's processing has to show the solutions for unpredictable status such as heterogeneity of hosts, variability of hosts, autonomy of hosts, the supporting performance continuously, and the number of hosts which are participated in computation and so on. In this paper, we propose the strategy of adaptive tack reallocation based on performance the host job processing, spread out geographically Also, It shows the scheme of dynamic host management with dynamic environment, which is changed by lots of hosts on the web during parallel processing for large-scale applications. This paper implements the PDSWeb (Parallel/Distributed Scheme on Web) system, evaluates and applies It to the generation of rendering image with highly intensive computation. The results are showed that the adaptive task reallocation with the variation of hosts has been increased up to maximum 90% and the improvement in performance according to add/delete of hosts.

웹에 존재하는 수많은 유휴상태 호스트들을 이용한 병렬/분산 처리는 대규모 응용문제에 대해 높은 가격 대 성능비를 가진다. 웹 환경에서 병렬/분산 처리를 위하여 호스트들의 이질성 및 가변성, 자율성, 지속적인 성능보장과 참여 호스트 수 변화 등 예측할 수 없는 상태에 대한 해결책을 제시하여야 한다. 본 논문은 지리적으로 떨어져 있는 참여 호스트들의 작업 처리를 성능에 기반하는 적응적 작업 재할당 전략을 제안한다. 또한, 대규모 응용문제의 병렬 처리 중에 호스트 수가 변하는 동적 환경에 대해 동적 호스트 관리 스킴을 제공한다. 본 논문에서는 PDSWeb (Parallel/Distributed Scheme on Web) 시스템을 구현하여, 많은 연산량을 지닌 랜더링 이미지 생성에 적용하여 평가한다. 그 결과 호스트의 가변성에 대해 적응적 작업 재할당은 최고 90%이상 향상하였으며. 호스트 추가와 삭제에 따른 성능 향상 정도를 보인다.

Keywords

References

  1. J. E. Baldeschwieler, R. D. Blumofe, and E. A. Brewer, 'ATLAS : An Infrastructure for Global Computing,' In Proc. of the 7th ACM SIGOPS European Workshop : System Support for Worldwide Application, 1996
  2. A. Vahdat, P. Eastham, C. Yoshikawa, E. Bealani, T. Anderson, D. Culler, and M. Dahiln, 'WebOS : Operating System Services For Wide Area Application,' Technical Report CSD-97-938, UC Berkeley, 1997
  3. P. Michael, and Z. Matthies,' JavaParty : Transparent Remote Objects in Java,' In ACM Workshop on Java for Science and Engineering Computation, 1997
  4. A. Baratloo, M. Karaul, Z. M. Kedem, and P. Wychoff, 'Charlotte : Metacomputing on the Web,' The 9th International Conference on Parallel and Distributed Computing Systems, Dijon, 1996 https://doi.org/10.1016/S0167-739X(99)00009-6
  5. T. Brecht, H. sandhu, M. Shan, and J. Talbot, 'ParaWeb : Towards World-Wide Supercomputing,' Proc. of the 7th ACM SIGOPS European workshop : System Support for Worldwide Application, Connemara, Ireland, 1996 https://doi.org/10.1145/504450.504484
  6. B. O. Christiansen, P. Cappello, M. F. Ionescu, M. O. Neary, and K. E. Schauser, 'Javelin : Internet-Based Parallel Computing Using Java,' ACM Workshop on Java for Science and Engineering Computation, 1997 https://doi.org/10.1002/(SICI)1096-9128(199711)9:11<1139::AID-CPE349>3.0.CO;2-K
  7. N. Camiel, S. London, N. Nisan, and O. Regev, 'The POPCORN Project : Distributed computing over the Internet in Java,' In Proc. 6th International World Wide Web Conference, 1997
  8. Hernani Pedroso, Luis M. Silva, Victor Batista, Paulo Martins, Guilherme Soares and Telmo Menezes, 'Web-based Metacomputing with JET,' In Proc. of Concurrency : Practice and Experience, 1997 https://doi.org/10.1002/(SICI)1096-9128(199711)9:11<1169::AID-CPE350>3.0.CO;2-6
  9. D. Caromel, W. Kauser, and J. Vayssiere, 'Java//: Towards Seamless Computing end Metacomputing in Java,' Concurrency Practice and Experience, p.1043-1061, 1998
  10. J. Dongarra, J. Bunch, D. Moler, and G. W. Stewart, 'LINPACK User's Guide,' SIAM, Philadelphia, 1979