Fixed-point design methodology of the hyperbolic tangent function using lookup tables with performance evaluation on FPGA

EasyChair Preprint no. 598

Abstract

The sigmoid functions, including the hyperbolic tangent, are widely used in artificial neural networks. Usually, artificial neural networks are implemented on a computer, in training and testing phases, using floating point arithmetic. In some situations it is necessary to improve the performance of neural networks, in such cases the implementations are designed for specific digital devices, using fixed point arithmetic. This strategy increases the speed, and reduces the hardware resources and consumed power. The sigmoid functions are non-linear systems because include exponentials and divisions operations, so they are the bottleneck of the artificial neuron design and cannot be implemented directly in fixed-point format. For this reason, several methods of approximation are used, mainly based on piecewise approximations. One of the most common technique is to use Look-up Tables, which store samples of the function. This method needs a lot of hardware resources, but it reaches the highest speed. The first objective, using lookup table approximations, is to explore the set of solutions and study the effect of the number of bits. This can only be achieved if an advanced design methodology is used for experimentation, a second objective is to expose this fast and flexible design method. Thirdly, the measure of functionality associated with the error is reviewed. A new functionality measure is proposed associated with the concept of signal to noise power relation. The new measure allows compare different approximations; besides, some linearities are observed against the number of bits. Afterwards, the implementations are developed on some Field Programmable Gate Arrays and the performances are evaluated: hardware resources, speed and consumed power. Again, some linear behaviours are observed. Finally, a quality factor is proposed, which includes functionality and physical performances, this factor allows comparison between different implementations.

Keyphrases: design methodology, digital circuit, fixed point, floating-point, FPGA, HDL, Hyperbolic Tangent, lookup table, MATLAB, Sigmoid function, signal to noise relation

@Booklet{EasyChair:598,
  author = {Santiago Tomás Pérez Suárez},
  title = {Fixed-point design methodology of the hyperbolic tangent function using lookup tables with performance evaluation on FPGA},
  howpublished = {EasyChair Preprint no. 598},
  doi = {10.29007/f23l},
  year = {EasyChair, 2018}}