Data-Flow Graph Mapping Optimization for CGRA With Deep Reinforcement Learning

作者：Liu, Dajiang^*; Yin, Shouyi; Luo, Guojie; Shang, Jiaxing; Liu, Leibo; Wei, Shaojun; Feng, Yong; Zhou, Shangbo

来源：IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2019, 38(12): 2271-2283.

DOI：10.1109/TCAD.2018.2878183

• Coarse-grained reconfigurable architecture (CGRA)
• data flow graph (DFG)
• mapping
• reinforcement learning (RL)

Coarse-grained reconfigurable architectures (CGRAs) have drawn increasing attention due to their flexibility and energy efficiency. Data flow graphs (DFGs) are often mapped onto CGRAs for acceleration. The problem of DFG mapping is challenging due to the diverse structures from DFGs and constrained hardware from CGRAs. Consequently, it is difficult to find a valid and high quality solution simultaneously. Inspired from the great progress in deep reinforcement learning (RL) for AI problems, we consider building methods that learn to map DFGs onto spatially programmed CGRAs directly from experiences. We propose RLMap, a solution that formulates DFG mapping on CGRA as an agent in RL, which unifies placement, routing and processing element insertion by interchange actions of the agent. Experimental results show that RLMap performs comparably to state-of-the-art heuristics in mapping quality, adapts to different architecture, and converges quickly.

• 出版日期2019-12
• 单位清华大学; 重庆大学; 北京大学