Different aspects of workflow scheduling in large-scale distributed systems

作者：Stavrinides Georgios L^*; Rodrigo Duro Francisco; Karatza Helen D; Garcia Blas Javier; Carretero Jesus

来源：Simulation Modelling Practice and Theory, 2017, 70: 120-134.

DOI：10.1016/j.simpat.2016.10.009

• Workflow scheduling
• Large-scale distributed systems
• Ultrascale systems
• Quality of Service
• Data locality

As large-scale distributed systems gain momentum, the scheduling of workflow applications with multiple requirements in such computing platforms has become a crucial area of research. In this paper, we investigate the workflow scheduling problem in large-scale distributed systems, from the Quality of Service (QoS) and data locality perspectives. We present a scheduling approach, considering two models of synchronization for the tasks in a workflow application: (a) communication through the network and (b) communication through temporary files. Specifically, we investigate via simulation the performance of a heterogeneous distributed system, where multiple soft real-time workflow applications arrive dynamically. The applications are scheduled under various tardiness bounds, taking into account the communication cost in the first case study and the I/O cost and data locality in the second. The simulation results provide useful insights into the impact of tardiness, bound and data locality on the system performance.

• 出版日期2017-1