A virtual memory foundation for scalable deterministic parallelism

作者：Zhang Yu^*; Ford Bryan

来源：2nd Asia-Pacific Workshop on Systems, APSys'11, 2011-07-11 to 2011-07-12.

DOI：10.1145/2103799.2103808

• Deterministic execution
• deterministic parallelism
• Memory region
• Parallel matrix multiplication
• Peer to peer
• Programming abstractions
• Synchronization models
• Thread scheduling
• Virtual memory

Recent deterministic execution environments promise efficient program replay and bug reproduction, but their scalability is currently limited by strictly hierarchical synchronization models or serialized thread scheduling mechanisms. To address these issues, we introduce a single-producer multiple-consumer (SPMC) virtual memory foundation for deterministic parallelism, which supports non-hierarchical synchronization without serialized thread scheduling. An extension to the Determinator microkernel, supporting SPMC memory regions, offers threads and processes scalable "peer-to-peer" communication while preserving the kernel's existing guarantee of system-enforced determinism. DetMP, a deterministic userlevel message passing API modeled on MPI, illustrates one way to build convenient application-level parallel programming abstractions atop the SPMC foundation. Preliminary results suggest that DetMP atop SPMC may be realistic and useful, achieving near-ideal speedup for parallel matrix multiplication, and good scaling for IS, in all cases ensuring strict determinism.

• 出版日期2011
• 单位中国科学技术大学