KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

A Methodology for Task placement and Scheduling Based on Virtual Machines

  • Chen, Xiaojun (School of computer science and engineering, Xi'an University of Technology) ;
  • Zhang, Jing (School of computer science and engineering, Xi'an University of Technology) ;
  • Li, Junhuai (School of computer science and engineering, Xi'an University of Technology)
  • Received : 2011.01.18
  • Accepted : 2011.09.07
  • Published : 2011.09.29
Download PDF
⟨ Previous Next ⟩

Abstract

Task placement and scheduling are traditionally studied in following aspects: resource utilization, application throughput, application execution latency and starvation, and recently, the studies are more on application scalability and application performance. A methodology for task placement and scheduling centered on tasks based on virtual machines is studied in this paper to improve the performances of systems and dynamic adaptability in applications development and deployment oriented parallel computing. For parallel applications with no real-time constraints, we describe a thought of feature model and make a formal description for four layers of task placement and scheduling. To place the tasks to different layers of virtual computing systems, we take the performances of four layers as the goal function in the model of task placement and scheduling. Furthermore, we take the personal preference, the application scalability for a designer in his (her) development and deployment, as the constraint of this model. The workflow of task placement and scheduling based on virtual machines has been discussed. Then, an algorithm TPVM is designed to work out the optimal scheme of the model, and an algorithm TEVM completes the execution of tasks in four layers. The experiments have been performed to validate the effectiveness of time estimated method and the feasibility and rationality of algorithms. It is seen from the experiments that our algorithms are better than other four algorithms in performance. The results show that the methodology presented in this paper has guiding significance to improve the efficiency of virtual computing systems.

Keywords

References

  1. E. Strohmaier, J.J. Dongarra, H.W. Meuer, H.D. Simon, "Recent Trends in the Marketplace of High Performance Computing," Parallel Computing, vol. 31, no.3-4, pp. 261-273, Mar. 2005, https://doi.org/10.1016/j.parco.2005.02.001
  2. S.L. Scott, G. Vallée, T. Naughton, H. Ong, "System-level Virtualization Research at Oak Ridge National Laboratory," Future Generation Computer Systems, vol. 26, no. 3, pp. 304-307, Mar. 2009.
  3. J.P. Walters, V. Chaudhary, M. Cha, et al, "A Comparison of Virtualization Technologies for HPC," in Proc. of 22nd International Conference on Advanced Information Networking and Applications, pp. 2-5, Mar. 2008,.
  4. T.S. Somasundaram, B.R. Amarnath, el al, "CARE Resource Broker: A Framework for Scheduling and Supporting Virtual Resource Management," Future Generation Computer Systems, vol. 26, no. 3, pp. 337-347, Mar. 2010 . https://doi.org/10.1016/j.future.2009.10.005
  5. M. Sustersic, D. Mramor, J. Zupan, "Consumer Credit Scoring Models with Limited Data," Expert Systems with Applications, vol. 36,no. 3, pp. 4736-4744, Apr. 2009 . https://doi.org/10.1016/j.eswa.2008.06.016
  6. Q. Li, J. Huai, J. Li,et al, " HyperMIP: Hypervisor Controlled Mobile IP for Virtual Machine Live Migration across Networks," in Proc. of High Assurance Systems Engineering Symposium, pp. 3-5, Aug. 2008.
  7. D.A. Grove, P.D. Coddington, "Modeling Message-passing Programs with a Performance Evaluating Virtual Parallel Machine," Performance Evaluation, vol. 60, no. 1-4, pp. 165-187, May 2005. https://doi.org/10.1016/j.peva.2004.10.019
  8. F. Ortin, J.M. Redondo, J.B.G. Perez-Schofield, "Efficient Virtual Machine Support of Runtime Structural Reflection," Science of Computer Programming, vol. 74, no. 10, pp. 836-860, Aug. 2009. https://doi.org/10.1016/j.scico.2009.04.001
  9. M. Bellato, R. Isocrate, G. Meng,e tc al, "Remoting Field Bus Control by Means of a PCI Express-based Optical Serial Link," Nuclear Instruments & Methods in Physics Research, vol. 570, no. 3, pp. 518-524, Aug. 2007. https://doi.org/10.1016/j.nima.2006.10.190
  10. S. Fu, "Failure-Aware Resource Management for High-Availability Computing Clusters with Distributed Virtual Machines," Journal of Parallel and Distributed Computing, vol. 70, no. 4, pp. 384-393, Apr. 2010. https://doi.org/10.1016/j.jpdc.2010.01.002
  11. T. Giorgino, M.J. Harvey, G. de Fabritiis, "Distributed Computing as a Virtual Supercomputer: Tools to Run and Manage Large-scale BOINC Simulations," Computer Physics Communications, vol. 181, no. 8, pp. 1402-1409, Mar. 2010. https://doi.org/10.1016/j.cpc.2010.04.007
  12. S.-M. Lee,D.-G. Kim, D.-R. Shin, "General Purpose Hardware Abstraction Layer for Multiple Virtual Machines in Mobile Devices," in Proc. of International Conference on Advanced Communication Technology, pp. 15-18, Feb. 2009.
  13. M. Arnold, S.J Fink, D. Grove, M. Hind, P.F. Sweeney, "A Survey of Adaptive Optimization in Virtual Machines," in Proc. of the IEEE Special Issue on Program Generation,Optimization,and Adaptation, vol. 93, no. 2, pp. 449-466, June 2005.
  14. K. Wang, A. Chang, L.V. Kale, J.A. Dantzig, "Parallelization of a Level Set Method for Simulating Dendritic Growth," Journal of Parallel and Distributed Computing, vol. 66, no. 11, pp. 1379-1386, Nov. 2006. https://doi.org/10.1016/j.jpdc.2006.02.005
  15. A. Acharya, N. Banerjee, D. Chakraborty, et al, "Programmable Presence Virtualization for Next-Generation Context-based Applications," in Proc. of 2009 IEEE International Conference on Pervasive Computing and Communications, pp. 9-13, Mar. 2009.
  16. S.K. Nair, P.N.D. Simpson, B. Crispo, A.S. Tanenbaum, "A Virtual Machine Based Information Flow Control System for Policy Enforcement," Electronic Notes in Theoretical Computer Science, vol. 197, no. 1, pp. 3-16, Feb. 2008. https://doi.org/10.1016/j.entcs.2007.10.010
  17. J. Wiegert, G. Regnier, J. Jackson, "Challenges for Scalable Networking in a Virtualized Server," in Proc. of 16th International Conference on Computer Communications and Networks, pp. 13-16, Aug. 2007.
  18. B. Li, J. Shu, W. Zheng, "Design and Implementation of a Storage Virtualization System Based on SCSI Target Simulator in SAN," Tsinghua Science & Technology, vol. 10, no. 1, pp. 122-127, Jan. 2005. https://doi.org/10.1016/S1007-0214(05)70018-3
  19. X. Wanga, Z. Dua,Y. Chenb, S. Lia, "Virtualization-based Autonomic Resource Management for Multi-tier Web Applications in Shared Data Center," Journal of Systems and Software, vol. 81, no. 9, pp. 1591-1608, Sep. 2008. https://doi.org/10.1016/j.jss.2007.11.719
  20. D. Gmach, J. Rolia, L. Cherkasova, A. Kemper, "Resource Pool Management- Reactive versus Proactive or Let's be Friends," Computer Networks, vol. 53, no. 17, pp. 2905-2922, Dec. 2009. https://doi.org/10.1016/j.comnet.2009.08.011
  21. A. Mtibaa, B. Ouni, M. Abid, "An Efficient List Scheduling Algorithm for Time Placement Problem," Computers & Electrical Engineering, vol. 33, no. 4, pp. 285-298, July 2007. https://doi.org/10.1016/j.compeleceng.2007.02.005
  22. K.G. Kakoulis, I.G. Tollis, "Algorithms for the Multiple Label Placement Problem," Computational Geometry, vol. 35, no. 3, pp. 143-161, Oct. 2006. https://doi.org/10.1016/j.comgeo.2006.03.005
  23. M. Fazlali, M. Sabeghi, A. Zakerolhosseini, K. Bertels, "Efficient Task Scheduling for Runtime Reconfigurable Systems," Journal of Systems Architecture, vol. 56, no. 11, pp. 623-632, Nov. 2010. https://doi.org/10.1016/j.sysarc.2010.07.016
  24. Y.-S. Dai , G. Levitin, X. Wang, "Optimal Task Partition and Distribution in Grid Service System with Common Cause Failures," Future Generation Computer Systems, vol. 23, no. 2, pp.2 09-218, Feb. 2007. https://doi.org/10.1016/j.future.2006.05.002
  25. H.J. Siegel, S. Ali , "Techniques for Mapping Tasks to Machines in Heterogeneous Computing Systems," Journal of Systems Architecture , vol. 46, no. 8, pp. 627-639, June 2000. https://doi.org/10.1016/S1383-7621(99)00033-8
  26. T.D. Braun, H.J. Siegel, A.A. Maciejewski, Y. Hong, " Static Resource Allocation for Heterogeneous Computing Environments with Tasks Having Dependencies, Priorities, Deadlines, and Multiple Versions," Journal of Parallel and Distributed computing, vol. 68, pp. 11, pp. 1504-1516, Nov. 2008 https://doi.org/10.1016/j.jpdc.2008.06.006
  27. J.-K. Kim, S. Shivle, H.J. Siegel, et al, "Dynamically Mapping Tasks with Priorities and Multiple Deadlines in a Heterogeneous Environment," Journal of Parallel and Distributed Computing, vol. 67, no. 2, pp. 154-169, Feb. 2007. https://doi.org/10.1016/j.jpdc.2006.06.005
  28. Y.-K. Kwok, A.A. Maciejewski, H.J. Siegel, I. Ahmad, A. Gharfoor, "A Semi-static Approach to Mapping Dynamic Iterative Tasks onto Heterogeneous Computing Systems," Journal of Parallel and Distributed Computing, vol. 66, no. 1, pp. 77-98, Jan. 2006. https://doi.org/10.1016/j.jpdc.2005.06.015
  29. M. Moore, "An Accurate Parallel Genetic Algorithm to Schedule Tasks on a Cluster," Parallel Computing, vol. 30, no. 5-6, pp. 567-583, May 2004. https://doi.org/10.1016/j.parco.2003.12.005
  30. Sau-Ming Lau,Qin Lu,Kwong-Sak Leung, "Adaptive load distribution algorithms for heterogeneous distributed systems with multiple task classes," Journal of Parallel and Distributed Computing, vol. 66, no. 2, pp. 163-180, Feb. 2006. https://doi.org/10.1016/j.jpdc.2004.01.007
  31. ZhuHai,Wang Yu-ping, "Constrained Multi-objective Grid Task Security Scheduling Model and Algorithm," Journal of Electronics & Information Technology, vol. 32, no. 4, pp. 988-992, Mar. 2010. https://doi.org/10.3724/SP.J.1146.2009.00634
  32. James Broberg, Zahir Tari, Panlop Zeephongsekul, "Task assignment with work-conserving migration," Parallel Computing, vol. 32, no. 11-12, pp. 808-830, Dec. 2006. https://doi.org/10.1016/j.parco.2006.09.005
  33. Laura Gilbert, Jeff Tseng, Rhys Newman, etc, "Implications of virtualization on Grids for high energy physics applications," Journal of Parallel and Distributed Computing, vol. 66, no. 7, pp. 922-930, July 2006. https://doi.org/10.1016/j.jpdc.2005.12.013
  34. Yong Liao, Dong Yin, Lixin Gao, "Network virtualization substrate with parallelized data plane," Computer Communications, vol. 34, no. 13, Aug. 2011.
  35. Flavio Lombardi, Roberto Di Pietro, "Secure virtualization for cloud computing," Journal of Network and Computer Applications, vol. 34, no. 4, July 2011.
  36. Michail D. Flouris, Renaud Lachaize, Konstantinos Chasapis, Angelos Bilas, "Extensible block-level storage virtualization in cluster-based systems," Journal of Parallel and Distributed Computing, vol. 70, no. 8, pp. 800-824, Aug.2010. https://doi.org/10.1016/j.jpdc.2010.03.001
  37. Mohammad I. Daoud, Nawwaf Kharma, "A high performance algorithm for static task scheduling in heterogeneous distributed computing systems," Journal of Parallel and Distributed Computing, vol. 68, no. 4, pp. 399-409, April 2008. https://doi.org/10.1016/j.jpdc.2007.05.015
  38. J.H. Abawajy, "Adaptive hierarchical scheduling policy for enterprise grid computing systems," Journal of Network and Computer Applications, vol. 32, no. 3, pp. 770-779, May 2009. https://doi.org/10.1016/j.jnca.2008.04.009
  39. Matthew Witten, "The role of high performance computing in medicine and public health," Future Generation Computer Systems, vol. 10, no. 2-3, pp. 223-232, June 1994. https://doi.org/10.1016/0167-739X(94)90021-3
  40. Hung-Ming Chen, Yu-Chin Lin, "Web-FEM: An internet-based finite-element analysis framework with 3D graphics and parallel computing environment," Advances in Engineering Software, vol. 39, no. 1, pp. 55-68, Jan. 2008. https://doi.org/10.1016/j.advengsoft.2006.12.001
  41. Tevfik Kosar, Miron Livny, "A framework for reliable and efficient data placement in distributed computing systems," Journal of Parallel and Distributed Computing, vol. 65, no. 10, pp. 1146-1157, Oct. 2005. https://doi.org/10.1016/j.jpdc.2005.04.019
  42. B. Hamidzadeh, L.Y. Kit, D.J. Lilja, "Dynamic task scheduling using online optimization," IEEE Trans. Parallel Distrib. Syst., no.11, pp. 1151-1163, Nov. 2000.
  43. S. Bansal, P. Kumar, K. Singh, "Dealing with heterogeneity through limited duplication for scheduling precedence constrained task graphs," J. Parallel Distrib. Comput, no. 65, pp. 479-491, Apr. 2005. https://doi.org/10.1016/j.jpdc.2004.11.006
  44. [W.F. Boyer, G.S. Hura, "Non-evolutionary algorithm for scheduling dependent tasks in distributed heterogeneous computing environments," J. Parallel Distrib. Comput., no. 65, pp. 1035-1046, Sep. 2005. https://doi.org/10.1016/j.jpdc.2005.04.017
  45. E. Ilavarasan, P. Thambidurai, R. Mahilmannan, "Performance effective task scheduling algorithm for heterogeneous computing system," in Proc. 4th International Symposium on Parallel and Distributed Computing, France, pp. 28-38, July 2005.
  46. J. Kim, J. Rho, J.-O. Lee, M.-C. Ko, , "CPOC: Effective static task scheduling for grid computing," in Proc. 2005 International Conference on High Performance Computing and Communications, Italy , pp. 477-486, Apr. 2005.
  47. Xiangzhen Kong, ChuangLin, YixinJiang,et al, "Efficient dynamic task scheduling in virtualized data centers with fuzzy prediction," Journal of Network and Computer Applications, pp. 1068-1077 July 2010.
  48. A. Iosup, C. Dumitrescu, D. Epema, H. Li, L. Wolters, "How are real grids used? The analysis of four grid traces and its implications," in Proc. 7th IEEE/ACM International Conference on Grid Computing, Spain, pp. 262-269, Sep. 2006.
  49. H. Topcuoglu, S. Hariri, M.Y. Wu , "Performance-effective and low-complexity task scheduling for heterogeneous computing," IEEE Trans. Parallel Distrib. Syst. no. 13, pp. 260-274, Mar. 2002.
  50. S. Bansal, P. Kumar, K. Singh, "An improved duplication strategy for scheduling precedence constrained graphs in multiprocessor systems," IEEE Trans. Parallel Distrib. Syst. no. 14, pp. 533-544, june 2003.
  51. A.Y. Zomaya, Y.H. Teh , "Observations on using genetic algorithms for dynamic load balancing," IEEE Trans. Parallel Distrib. Syst., no. 12, pp. 899-911, Sep. 2001.
  52. S. Baskiyar, C. Dickinson, "Scheduling directed a-cyclic task graphs on a bounded set of heterogeneous processors using task duplication," J. Parallel Distrib. Comput., no. 65, pp. 911-921, Aug. 2005.
  53. J. Grefenstette, Rank-based selection, in: T. Back, D.B. Fogel, Z. Michalewicz, "Handbook of Evolutionary Computation, first ed," Oxford Univ. Press, pp. 241-246,1997
  54. A. Radulescu, A.J.C. van Gemund , "Low-cost task scheduling for distributedmemory machines," IEEE Trans. Parallel Distrib. Syst., no. 13, pp. 648-658, Sep. 2002
  55. M. Wu, D. Dajski, "Hypertool: A programming aid for message passing systems," IEEE Trans. Parallel Distrib. Syst., no. 1, pp. 330-343, July 1990.
  56. S. Nesmachnow, H. Cancela, E. Alba, "Heterogeneous computing scheduling with evolutionary algorithms," Soft Computing-A Fusion of Foundations, Methodologies and Applications, vol. 15, no. 4, pp. 685-701, Apr. 2010.
  57. P. Phinjaroenphan, S. Bevinakoppa, P. Zeephongsekul, "A method for estimating the execution time of a parallel task on a grid node," Lecture Notes in Computer Science, vol. 3470, pp. 226-236, Jan. 2005.
  58. M.A. Iverson, F. Ozguner, L. Potter, "Statistical prediction of task execution times through analytic benchmarking for scheduling in a heterogeneous environment," IEEE Trans. Comput., pp. 1374-1379, Apr. 1999.
  59. G.C. Sih, E.A. Lee, "A compile-time scheduling heuristic for interconnectionconstrained heterogeneous processor architectures," IEEE Trans. Parallel Distrib. Syst., no. 4, pp. 175-187, Feb. 1993.
  60. H. El-Rewini, T.G. Lewis, "Scheduling parallel program tasks onto arbitrary target machines," J. Parallel Distrib. Comput., no. 9, pp. 138-153, June 1990.
  61. S.V. Kumar, C.D. Peters-Lidard, Y. Tian, etc, "Land information system: An interoperable framework for high resolution land surface modeling," Environmental Modelling & Softwar, vol. 21, no. 10, pp. 1402-1415, Feb. 2006. https://doi.org/10.1016/j.envsoft.2005.07.004
  62. Deshi Ye, Guochuan Zhang, "On-line scheduling of multi-core processor tasks with virtualization," Operations Research Letters, vol. 38, no. 4, pp. 307-311, July 2010. https://doi.org/10.1016/j.orl.2010.04.002
  63. Katia Leal, Eduardo Huedo, Ignacio M. Llorente, "A decentralized model for scheduling independent tasks in Federated Grids," Future Generation Computer Systems, vol. 25, no. 8, pp. 840-852, Sep. 2009. https://doi.org/10.1016/j.future.2009.02.003