Model-based MPI-IO tuning with Periscope tuning framework

作者：Liu, Weifeng^*; Gerndt, Michael; Gong, Bin

来源：Concurrency and Computation: Practice and Experience (CCPE) , 2016, 28(1): 3-20.

DOI：10.1002/cpe.3603

• parallel I/O
• automatic tuning
• MPI-IO
• performance model
• high-performance computing

For many parallel applications, I/O performance is a major bottleneck. MPI-IO, defined by the MPI forum, can help parallel applications overcome the performance and portability limitations of existing parallel I/O interfaces. Although autotuning has been used to improve the performance of computing kernels, MPI-IO autotuning has rarely been studied. To automate MPI-IO performance tuning, we designed and implemented an automatic tuner. The tuner relies on the Periscope tuning framework for transparently passing hints to the MPI-IO library and for automatically collecting performance data. Unlike computational code, each MPI-IO function takes a relatively long time to complete. Thus, exhaustively searching through the entire parameter space is impractical. So we developed a performance model that can direct us to shorten the tuning time.

• 出版日期2016-1
• 单位山东大学