A holistic approach to build real-time stream processing system with GPU

作者：Zhang Kai; Hu Jiayu; Hua Bei^*

来源：Journal of Parallel and Distributed Computing, 2015, 83: 44-57.

DOI：10.1016/j.jpdc.2015.05.002

• GPU
• High-speed networking
• Real-time
• Stream processing

Stream processing needs to process huge volume of data with strict deadline requirements. These applications generally consume large amount of network bandwidth and involve compute-intensive operations. Accelerating such operations with general purpose GPU has drawn a lot of attention from both academia and industry. However, GPU has not been applied to real-time stream processing due to its programming paradigm and unpredictable latency.
In this paper, we study the problem of applying GPU to real-time processing and propose a holistic approach for building real-time stream processing system with GPU. Based on the proposed techniques, we build a GPU-accelerated SRTP reverse proxy that achieves more than 10Gbps overall throughput and guarantees low latency. Our work demonstrates that using GPU in high-speed real-time stream processing is both feasible and attractive.

• 出版日期2015-9
• 单位中国科学技术大学苏州研究院