ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Optimal Heterogeneous Distributed Storage Regenerating Code at Minimum Remote-Repair Bandwidth Regenerating Point

  • Xu, Jian (School of Information Science and Engineering, Shandong University) ;
  • Cao, Yewen (School of Information Science and Engineering, Shandong University) ;
  • Wang, Deqiang (School of Information Science and Engineering, Shandong University) ;
  • Wu, Changlei (School of Information Science and Engineering, Shandong University) ;
  • Yang, Guang (School of Information Science and Engineering, Shandong University)
  • Received : 2015.05.15
  • Accepted : 2015.12.28
  • Published : 2016.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, a product-matrix (PM) framework was proposed to construct optimal regenerating codes for homogeneous distributed storage systems (DSSs). In this paper, we propose an extended PM (EPM) framework for coding of heterogeneous DSSs having different repair bandwidths but identical storage capacities. Based on the EPM framework, an explicit construction of minimum remote-repair bandwidth regenerating (MRBR) codes is presented for a specific heterogeneous DSS, where two geographically different datacenters with associated storage nodes are deployed. The data reconstruction and regeneration properties of the MRBR code are proved strictly. For the purpose of demonstration, an example implementation of MRBR code is provided. The presented MRBR code is the first optimal strict-regenerating code for heterogeneous DSSs. In addition, our proposed EPM framework can be applied to homogeneous systems also.

Keywords

References

  1. Y.J. Chen, C.H. Liao, and L.C. Wang, "An Eavesdropping Prevention Problem when Repairing Network Coded Data from Remote Distributed Storage," Global Commun. Conf., Atlanta, GA, USA, Dec. 9-13, 2013, pp. 2711-2716.
  2. A.G. Dimakis et al., "Network Coding for Distributed Storage Systems," IEEE Trans. Inf. Theory, vol. 56, no. 9, Sept. 2010, pp. 4539-4551. https://doi.org/10.1109/TIT.2010.2054295
  3. R. Bhagwan et al., "Total Recall: System Support for Automated Availability Management," Symp. Networked Syst. Des. Implementation, San Francisco, CA, USA, Mar. 29-31, 2004, pp. 337-350.
  4. F. Dabek et al., "Designing a DHT for Low Latency and High Throughput," Symp. Networked Syst. Des. Implementation, San Francisco, CA, USA, Mar. 29-31, 2004, pp. 85-98.
  5. S. Rhea et al., "Pond: The OceanStore Prototype," USENIX Conf. File Storage Technol., San Francisco, CA, USA, Mar. 31-Apr. 2, 2003, pp. 1-14.
  6. H. Weatherspoon and J.D. Kubiatowicz, "Erasure Coding vs. Replication: A Quantitative Comparison," in Peer-to-Peer Syst.: 1st Int. Workshop, IPTPS 2002 Cambridge, MA, USA, Mar. 7-8, 2002, Revised Papers, Heidelberg, Germany: Springer, 2002, pp. 328-337.
  7. R. Rodrigues and B. Liskov, "High Availability in DHTs: Erasure Coding vs. Replication," in Peer-to-Peer Syst. IV: Int. Workshop, Ithaca, NY, USA, Feb. 24-25, 2005, Revised Sel. Papers, Heidelberg, Germany: Springer, 2005, pp. 226-239.
  8. K.V. Rashmi, N.B. Shah, and P.V. Kumar, "Optimal Exact-Regenerating Codes for the MSR and MBR Points via a Product-Matrix Construction," IEEE Trans. Inf. Theory, vol. 57, no. 8, Aug. 2011, pp. 5227-5239. https://doi.org/10.1109/TIT.2011.2159049
  9. K.V. Rashmi et al., "Explicit Construction of Optimal Exact Regenerating Codes for Distributed Storage," Ann. Allerton Conf. Commun., Contr., Comput., Monticello, IL, USA, Sept. 30-Oct. 2, 2009, pp. 1243-1249.
  10. O. Olmez and A. Ramamoorthy, "Repairable Replication-Based Storage Systems Using Resolvable Designs," Ann. Allerton Conf. Commun., Contr., Comput., Monticello, IL, USA, Oct. 1-5, 2012, pp. 1174-1181.
  11. Y.S. Han et al., "Update-Efficient Error-Correcting Product-Matrix Codes," IEEE Trans. Commun., vol. 63, no. 6, June 2015, pp. 1925-1938. https://doi.org/10.1109/TCOMM.2015.2424416
  12. T. Ernvall, "Codes between MBR and MSR Points with Exact Repair Property," IEEE Trans. Inf. Theory, vol. 60, no. 11, Nov. 2014, pp. 6993-7005. https://doi.org/10.1109/TIT.2014.2351252
  13. S. Pawar, S. El Rouayheb, and K. Ramchandran, "On Secure Distributed Data Storage under Repair Dynamics," IEEE Int. Symp. Inf. Theory, Austin, TX, USA, July 13, 2010, pp. 2543-2547.
  14. N.B. Shah, K. Rashmi, and P.V. Kumar, "Information-Theoretically Secure Regenerating Codes for Distributed Storage," IEEE Global Telecommun. Conf., Houston, TX, USA, Dec. 5-9, 2011, pp. 1-5.
  15. J. Kubiatowicz et al., "OceanStore: An Architecture for Global-Scale Persistent Storage," Int. Conf. Architectural Support Programming Languages Operaing Syst., Cambridge, MA, USA, Nov. 12-15, 2000, pp. 190-201.
  16. A. Ha, P2P Startup Space Monkey Raises 2.25 m Led by Google Ventures and Venture 51, Aol TechCrunch, July 11, 2012, Accessed Feb. 25, 2015. http://techcrunch.com/2012/07/11/space-monkey-seed-round
  17. H. Zhang et al., "A Distributed Multichannel Demand-Adaptive P2P VoD System with Optimized Caching and Neighbor-Selection," Proc. SPIE, San Diego, CA, USA, Aug. 22-24, 2011, pp. 81350X-1-81350X-19.
  18. S. Pawar et al., "Codes for a Distributed Caching Based Videoon-Demand System," Conf. Record Asilomar Conf. Signals, Syst., Comput., Pacific Grove, CA, USA, Nov. 6-9, 2011, pp. 1783-1787.
  19. N. Golrezaei, A.G. Dimakis, and A.F. Molisch, "Wireless Deviceto-Device Communications with Distributed Caching," IEEE Int. Symp. Inf. Theory Proc., Cambridge, MA, USA, July 1-6, 2012, pp. 2781-2785.
  20. T. Ernvall et al., "Capacity and Security of Heterogeneous Distributed Storage Systems," IEEE J. Sel. Areas Commun., vol. 31, no. 12, Dec. 2013, pp. 2701-2709. https://doi.org/10.1109/JSAC.2013.131210
  21. Q. Yu, K.W. Shum, and C.W. Sung, "Tradeoff between Storage Cost and Repair Cost in Heterogeneous Distributed Storage Systems," Trans. Emerg. Telecommun. Technol., vol. 26, no. 10, Oct. 2015, pp. 1201-1211. https://doi.org/10.1002/ett.2887
  22. K.G. Benerjee and M.K. Gupta, "Tradeoff for Heterogeneous Distributed Storage Systems between Storage and Repair Cost." Preprint, submitted Mar. 8, 2015. http://arxiv.org/abs/1503.02276v1
  23. V.T. Van, C. Yuen, and J. Li, "Non-homogeneous Distributed Storage Systems," Ann. Allerton Conf. Commun., Contr., Comput., Monticello, IL, USA, Oct. 1-5, 2012, pp, 1133-1140.
  24. Q. Yu, C.W. Sung, and T.H. Chan, "Irregular Fractional Repetition Code Optimization for Heterogeneous Cloud Storage," IEEE J. Sel. Areas Commun., vol. 32, no. 5, May 2014, pp. 1048-1060. https://doi.org/10.1109/JSAC.2014.140523
  25. D. Leong, A.G. Dimakis, and T. Ho, "Distributed Storage Allocations," IEEE Trans. Inf. Theory, vol. 58, no. 7, July 2012, pp. 4733-4752. https://doi.org/10.1109/TIT.2012.2191135
  26. V. Ntranos, G. Caire, and A.G. Dimakis, "Allocations for Heterogenous Distributed Storage," IEEE Int. Symp. Inf. Theory Proc., Cambridge, MA, USA, July 1-6, 2012, pp. 2761-2765.
  27. J. Pernas et al., "Non-homogeneous Two-Rack Model for Distributed Storage Systems," IEEE Int. Symp. Inf. Theory Proc., Istanbul, Turkey, July 7-2, 2013, pp. 1237-1241.
  28. N.B. Shah, K.V. Rashmi, and P.V. Kumar, "A Flexible Class of Regenerating Codes for Distributed Storage," IEEE Int. Symp. Inf. Theory Proc., Austin, TX, USA, July 13-18, 2010, pp. 1943-1947.
  29. C. Huang et al., "Erasure Coding in Windows Azure Storage." USENIX Ann. Tech. Conf., Boston, MA, USA, June 13-15, 2012, pp. 82-96.