A compound OpenMP/MPI program development toolkit for hybrid CPU/GPU clusters

作者：Li Hung Fu; Liang Tyng Yeu^*; Chiu Jun Yao

来源：Journal of Supercomputing, 2013, 66(1): 381-405.

DOI：10.1007/s11227-013-0912-0

• Hybrid CPU/GPU clusters
• Compound OpenMP/MPI
• CUDA
• Load balance
• Device directive

In this paper, we propose a program development toolkit called OMPICUDA for hybrid CPU/GPU clusters. With the support of this toolkit, users can make use of a familiar programming model, i.e., compound OpenMP and MPI instead of mixed CUDA and MPI or SDSM to develop their applications on a hybrid CPU/GPU cluster. In addition, they can adapt the types of resources used for executing different parallel regions in the same program by means of an extended device directive according to the property of each parallel region. On the other hand, this programming toolkit supports a set of data-partition interfaces for users to achieve load balance at the application level no matter what type of resources are used for the execution of their programs.

• 出版日期2013-10