Advanced SearchSearch Tips
File Block Management for Energy-Efficient Distributed Storages
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
File Block Management for Energy-Efficient Distributed Storages
Suh, Min-Kook; Kim, Seong-Woo; Seo, Seung-Woo;
  PDF(new window)
Because of rapid growth of data size, the number of data storage has been increased. When using multiple data storages, a distribute file system is essential to insure the availability of data files. The power consumption is a major problem when using a distributed file system with many data storages. Previous works have aimed at reducing the energy consumption with efficient file block layout by changing some data servers into stand-by mode. The file block migration has not been seriously considered because migration causes large cost. But when we consider addition of a new data server or file, file block migration is needed. This paper formulates the minimization of data block migration as an ILP optimization problem and solves it using branch-and-bound method. Using this technique, we can maximize the number of stand-by data servers with the minimum number of file block movement. However, computation time of branch-and-bound method of an ILP optimization problem increases exponentially as the problem size grows. Therefore this paper also proposes a data block and data server grouping method to solve many small ILP problems.
a distributed storage;energy efficiency;erasure code;ILP;power proportionality;
 Cited by
S. Ghemawat, H. Gobioff, and S. Leung, "The Google file system," in SIGOPS Oper. Syst. Rev. vol 37, no 5, pp. 29-43, Oct. 2003 crossref(new window)

R. T. Kaushik, M. Bhandarkar, and K. Nahrstedt, "Evaluation and analysis of green HDFS: A self-adaptive, energy- conserving variant of the Hadoop distributed file system," in Cloud Computing Technology and Science (CloudCom), 2010 IEEE Second International Conference on, pp. 274-287, Nov. 2010

J. Guerra, W. Belluomini, J. Glider, K. Gupta, and H. Pucha, "Energy proportionality for storage: impact and feasibility," in SIGOPS Oper. Syst. Rev. vol 44, no 1, pp. 35-39, Mar. 2010

X. Fan, W. Weber, and L. A. Barroso, "Power provisioning for a warehouse-sized computer," in SIGARCH Comput. Archit. News, vol 35, no 2, pp. 13-23, June 2007

T. Bostoen, S. Mullender, and Y. Berbers. "Power-reduction techniques for data-center storage systems." in ACM Comput. Surv. vol 45, issue 3, no 33, pp. 1-38, July 2013

S. Gurumurthiy, A. Sivasubramaniamy, M. Kandemiry, and H. Frankez, "DRPM: Dynamic speed control for power management in server class disks," in Proceedings of the International Symposium on Computer Architecture (ISCA), pp. 169-179, Jun. 2003

E. Pinheiro and R. Bianchini. "Energy conservation techniques for disk array-based servers," in Proceedings of the 18th annual international conference on Supercomputing (ICS '04), pp. 68-78, ACM, New York, NY, USA, June 2004.

E. Thereska, A. Donnelly, and D. Narayanan, "Sierra: Practical power-proportionality for data center storage," in Proceedings of the sixth conference on Computer systems (EuroSys '11), pp. 169-182, ACM, New York, NY, USA, Apr. 2011

H. Amur, J. Cipar, V. Gupta, G. R. Ganger, M. A. Kozuch, and K. Schwan, "Robust and flexible power-proportional storage," in Proceedings of the 1st ACM symposium on Cloud computing (SoCC '10), pp. 217-228, ACM, New York, NY, USA, Jun. 2010

B. Lin, S. L, X. Liao, Q. Wu, and S. Yang, "eStor: Energy efficient and resilient data center storage," in Cloud and Service Computing (CSC), 2011 International Conference on, pp. 366-371, Dec. 2011

H. Goudarzi, M. Ghasemazar, M. Pedram, "SLA-based optimization of power and migration cost in cloud computing," in Cluster, Cloud and Grid Computing (CCGrid), 2012 12th IEEE/ACM International Symposium on, pp. 172-179, May 2012

A. G. Dimakis, P. B. Godfrey, Y. Wu, M. J. Wainwright, and K. Ramchandran, "Network coding for distributed storage systems," in Information Theory, IEEE Transactions on, vol 56, no 9, pp. 4539-4551, Sep. 2010 crossref(new window)