JOURNAL BROWSE
Search
Advanced SearchSearch Tips
Effects of Hypervisor on Distributed Big Data Processing in Virtualizated Cluster Environment
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Effects of Hypervisor on Distributed Big Data Processing in Virtualizated Cluster Environment
Chung, Haejin; Nah, Yunmook;
 
 Abstract
Recently, cluster computing environments have been in a process of change toward virtualized cluster environments. The change of the cluster environment has great impact on the performance of large volume distributed processing. Therefore, many domestic and international IT companies have invested heavily in research on cluster environments. In this paper, we show how the hypervisor affects the performance of distributed processing of a large volume of data. We present a performance comparison of MapReduce processing in two virtualized cluster environments, one built using the Xen hypervisor and the other built using the container-based Docker. Our results show that Docker is faster than Xen.
 Keywords
virtualization;cluster environment;hypervisor;docker;MapReduce;
 Language
Korean
 Cited by
1.
가상화 환경의 안전한 데이터 공유를 위한 다중 인스턴스간 상호인증 기법,최도현;김상근;

한국인터넷방송통신학회논문지, 2016. vol.16. 6, pp.83-94 crossref(new window)
1.
Mutual Authentication Scheme between Multiple Instances for Secure Data Share of Virtualized Environment, The Journal of the Institute of Internet Broadcasting and Communication, 2016, 16, 6, 83  crossref(new windwow)
 References
1.
Cheolsu Lim, "Technology Trends on Big Data Analysis Tools," (The)journal of Korean institute of next generation computing, Vol. 10, No. 5, pp. 77-84, 2014.

2.
Paul Barham, Boris Dragovic, Keir Fraser, Steven Hand, Tim Harris, Alex Ho, Rolf Neugebauery, Ian Pratt, Andrew Warfield, "Xen and the Art of Virtualization," The ACM Symposium on Operating Systems Principles, pp. 164-177, 2003.

3.
J. Dean and S. Ghemawat, "MapReduce : Simplied Data Processing on Large Clusters," CACM, Vol. 51, No. 1, pp. 107-113, 2008.

4.
Yoonho Kim, Haejin Chung, Wonsuk Choi, Joonmo Kim, JongMoo Choi, "Effects of Reduce Task Number on Performance of I/O-intensive MapReduce Applications in Virtualization Environment," Journal of Computing Science and Engineering, Vol. 19, No. 7, pp. 403-407, 2013. (in Korean)

5.
http://www.docker.com/whatisdocker

6.
Deshane, T., Shepherd, Z., Matthews, J., Ben-Yehuda, M., Shah, A., &Rao, B., "Quantitative comparison of Xen and KVM," Xen Summit, Boston, MA, USA, pp. 1-2, 2008.

7.
Gomes Xavier, Miguel, et al., "A performance comparison of container-based virtualization systems for mapreduce clusters," Parallel, Distributed and Network-Based Processing (PDP), 2014 22nd Euromicro International Conference on. IEEE, pp. 299-306, 2014.

8.
Shvachko K, KuangH, RadiaS, ChanslerR., "The hadoop distributed file system," IEEE 26 the symposium on mass storage systems and technologies (MSST), IEEE, pp. 1-10, 2010.