A Hardware-Efficient Sigmoid Function With Adjustable Precision for a Neural Network System

作者：Tsai Chang Hung^*; Chih Yu Ting; Wong Wing Hung; Lee Chen Yi

来源：IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2015, 62(11): 1073-1077.

DOI：10.1109/TCSII.2015.2456531

• Adjustable precision
• deep learning
• hardware efficient
• neural network
• sigmoid function

A hardware-efficient sigmoid function calculator with adjustable precision for neural network and deep-learning applications is proposed in this brief. By adopting the bit-plane format of the input and output values, the computational latency of the processing time can be dynamically reduced according to the user configuration. To reduce the hardware cost, the coefficients used to calculate the sigmoid value can be shared for multiple calculators without any structural hazard. In addition, the restricted constraint is applied in the coefficients' training stage to further simplify the computation in the calculation stage with a negligible quality loss. A test module is designed for the proposal and operated at 300 MHz to achieve 75 million sigmoid calculations per second. Implemented in 90-nm CMOS technology, the core of the calculator costs 1663 gates, and a 1-kb globally shared memory is used to store the coefficients.

• 出版日期2015-11