Approximate Message-Passing Decoder and Capacity Achieving Sparse Superposition Codes

作者：Barbier Jean^*; Krzakala Florent

来源：IEEE Transactions on Information Theory, 2017, 63(8): 4894-4927.

DOI：10.1109/TIT.2017.2713833

• Sparse superposition codes
• error-correcting codes
• additive white Gaussian noise channel
• approximate message-passing
• spatial coupling
• power allocation
• compressed sensing
• capacity achieving
• state evolution
• replica analysis
• fast Hadamard operator

We study the approximate message-passing decoder for sparse superposition coding on the additive white Gaussian noise channel and extend our preliminary work. We use heuristic statistical-physics-based tools, such as the cavity and the replica methods, for the statistical analysis of the scheme. While superposition codes asymptotically reach the Shannon capacity, we show that our iterative decoder is limited by a phase transition similar to the one that happens in low density parity check codes. We consider two solutions to this problem, that both allow to reach the Shannon capacity: 1) a power allocation strategy and 2) the use of spatial coupling, a novelty for these codes that appears to be promising. We present, in particular, simulations, suggesting that spatial coupling is more robust and allows for better reconstruction at finite code lengths. Finally, we show empirically that the use of a fast Hadamard-based operator allows for an efficient reconstruction, both in terms of computational time and memory, and the ability to deal with very large messages.

• 出版日期2017-8