Power Function Algorithms Implemented in Microcontrollers and FPGAs
-
Published:2023-08-10
Issue:16
Volume:12
Page:3399
-
ISSN:2079-9292
-
Container-title:Electronics
-
language:en
-
Short-container-title:Electronics
Author:
Moroz Leonid1, Samotyy Volodymyr2ORCID, Gepner Paweł1ORCID, Węgrzyn Mariusz2, Nowakowski Grzegorz2ORCID
Affiliation:
1. Faculty of Mechanical and Industrial Engineering, Warsaw University of Technology, 00-661 Warszawa, Poland 2. Faculty of Electrical and Computer Engineering, Cracow University of Technology, Warszawska 24 Str., 31-155 Cracow, Poland
Abstract
The exponential function ax is widespread in many fields of science. Its calculation is a complicated issue for Central Processing Units (CPUs) and Graphics Processing Units (GPUs), as well as for specialised Digital Signal Processing (DSP) processors, such as Intelligent Processor Units (IPUs), for the needs of neural networks. This article presents some simple and accurate exponential function calculation algorithms in half, single, and double precision that can be prototyped in Field-Programmable Gate Arrays (FPGAs). It should be noted that, for the approximation, the use of effective polynomials of the first degree was proposed in most cases. The characteristic feature of such algorithms is that they only contain fast ‘bithack’ operations (‘bit manipulation technique’) and Floating-Point (FP) addition, multiplication, and (if necessary) Fused Multiply-Add (FMA) operations. We published an article on algorithms for this class of function recently, but the focus was on the use of approximations of second-degree polynomials and higher, requiring two multiplications and two additions or more, which poses some complications in FPGA implementation. This article considers algorithms based on piecewise linear approximation, with one multiplication and one addition. Such algorithms of low complexity provide decent accuracy and speed, sufficient for practical applications such as accelerators for neural networks, power electronics, machine learning, computer vision, and intelligent robotic systems. These are FP-oriented algorithms; therefore, we briefly describe the characteristic parameters of such numbers.
Funder
Faculty of Electrical and Computer Engineering, Cracow University of Technology and the Ministry of Science and Higher Education, Republic of Poland
Subject
Electrical and Electronic Engineering,Computer Networks and Communications,Hardware and Architecture,Signal Processing,Control and Systems Engineering
Reference18 articles.
1. Wei, J., Kuwana, A., Kobayashi, H., and Kubo, K. (2021, January 26–29). Divide and Conquer: Floating-Point Exponential Calculation Based on Taylor-Series Expansion. Proceedings of the IEEE 14th International Conference on ASIC (ASICON), Kunming, China. 2. Eissa, S., Stuijk, S., and Corporaal, H. (2021, January 6–9). Hardware Approximation of Exponential Decay for Spiking Neural Networks. Proceedings of the IEEE 3rd International Conference on Artificial Intelligence Circuits and Systems (AICAS), Washington, DC, USA. 3. Geng, X., Lin, J., Zhao, B., Wang, Z., Aly, M.M.S., and Chandrasekhar, V. (2018, January 2–6). Hardware-Aware Exponential Approximation for Deep Neural Networks. Proceedings of the 14th Asian Conference on Computer Vision, Perth, Australia. 4. A Fast, Compact Approximation of the Exponential Function;Schraudolph;Neural Comput.,1999 5. Simple Multiple Precision Algorithms for Exponential Functions [Tips & Tricks];Moroz;IEEE Signal Process. Mag.,2022
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
|
|