Advanced SearchSearch Tips
Effects of Hypervisor on Distributed Big Data Processing in Virtualizated Cluster Environment
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Effects of Hypervisor on Distributed Big Data Processing in Virtualizated Cluster Environment
Chung, Haejin; Nah, Yunmook;
Recently, cluster computing environments have been in a process of change toward virtualized cluster environments. The change of the cluster environment has great impact on the performance of large volume distributed processing. Therefore, many domestic and international IT companies have invested heavily in research on cluster environments. In this paper, we show how the hypervisor affects the performance of distributed processing of a large volume of data. We present a performance comparison of MapReduce processing in two virtualized cluster environments, one built using the Xen hypervisor and the other built using the container-based Docker. Our results show that Docker is faster than Xen.
virtualization;cluster environment;hypervisor;docker;MapReduce;
 Cited by
가상화 환경의 안전한 데이터 공유를 위한 다중 인스턴스간 상호인증 기법,최도현;김상근;

한국인터넷방송통신학회논문지, 2016. vol.16. 6, pp.83-94 crossref(new window)
Mutual Authentication Scheme between Multiple Instances for Secure Data Share of Virtualized Environment, The Journal of the Institute of Internet Broadcasting and Communication, 2016, 16, 6, 83  crossref(new windwow)
Cheolsu Lim, "Technology Trends on Big Data Analysis Tools," (The)journal of Korean institute of next generation computing, Vol. 10, No. 5, pp. 77-84, 2014.

Paul Barham, Boris Dragovic, Keir Fraser, Steven Hand, Tim Harris, Alex Ho, Rolf Neugebauery, Ian Pratt, Andrew Warfield, "Xen and the Art of Virtualization," The ACM Symposium on Operating Systems Principles, pp. 164-177, 2003.

J. Dean and S. Ghemawat, "MapReduce : Simplied Data Processing on Large Clusters," CACM, Vol. 51, No. 1, pp. 107-113, 2008.

Yoonho Kim, Haejin Chung, Wonsuk Choi, Joonmo Kim, JongMoo Choi, "Effects of Reduce Task Number on Performance of I/O-intensive MapReduce Applications in Virtualization Environment," Journal of Computing Science and Engineering, Vol. 19, No. 7, pp. 403-407, 2013. (in Korean)


Deshane, T., Shepherd, Z., Matthews, J., Ben-Yehuda, M., Shah, A., &Rao, B., "Quantitative comparison of Xen and KVM," Xen Summit, Boston, MA, USA, pp. 1-2, 2008.

Gomes Xavier, Miguel, et al., "A performance comparison of container-based virtualization systems for mapreduce clusters," Parallel, Distributed and Network-Based Processing (PDP), 2014 22nd Euromicro International Conference on. IEEE, pp. 299-306, 2014.

Shvachko K, KuangH, RadiaS, ChanslerR., "The hadoop distributed file system," IEEE 26 the symposium on mass storage systems and technologies (MSST), IEEE, pp. 1-10, 2010.