Anti-Jamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning Approach

作者：Liu, Xin; Xu, Yuhua^*; Jia, Luliang; Wu, Qihui; Anpalagan, Alagan

来源：IEEE Communications Letters, 2018, 22(5): 998-1001.

DOI：10.1109/LCOMM.2018.2815018

• Anti-jamming
• deep Q-network
• deep reinforcement learning

This letter investigates the problem of anti-jamming communications in a dynamic and intelligent jamming environment through machine learning. Different from existing studies which need to know (estimate) the jamming patterns and parameters, we use the temporal and spectral information, i.e., the spectrum waterfall, directly. First, to cope with the challenge of infinite state of spectrum waterfall, a recursive convolutional neural network is designed. Then, an anti-jamming deep reinforcement learning algorithm is proposed to obtain the optimal anti-jamming strategies. Finally, simulation results validate the proposed approach. The proposed algorithm does not need to model the jamming patterns, and naturally has the ability to explore the unknown environment, which implies that it can be widely used for combating dynamic and intelligent jamming.

• 出版日期2018-5
• 单位桂林理工大学; 南京航空航天大学