A user mode CPU-GPU scheduling framework for hybrid workloads

作者：Wang, Bin; Ma, Ruhui; Qi, Zhengwei^*; Yao, Jianguo; Guan, Haibing

来源：Future Generation Computer Systems-The International Journal of eScience, 2016, 63: 25-36.

DOI：10.1016/j.future.2016.03.011

• Hybrid workloads
• CPU-GPU resource management
• Scheduling
• Switched control

Cloud platforms composed of multi-core CPU and many-core Graphics Processing Unit (GPU) have become powerful platforms to host incremental CPU GPU workloads. In this paper, we study the problem of optimizing the CPU resource management while keeping the quality of service (QoS) of games. To this end, we propose vHybrid, a lightweight user mode runtime framework, in which we integrate a scheduling algorithm for GPU and two algorithms for CPU to efficiently utilize CPU resources with the control accuracy of QoS. vHybrid can maintain the desired QoS with low CPU utilization, while being able to guarantee better QoS performance with little overhead. Our evaluations show that vHybrid saves 37.29% of CPU utilization with satisfactory QoS for hybrid workloads, and reduces three orders of magnitude for QoS fluctuations, without any impact on GPU workloads.

• 出版日期2016-10
• 单位上海交通大学