Affiliation:
1. School of Electrical Engineering, Kookmin University, Seoul 02707, Republic of Korea
Abstract
Memristor crossbars offer promising low-power and parallel processing capabilities, making them efficient for implementing convolutional neural networks (CNNs) in terms of delay time, area, etc. However, mapping large CNN models like ResNet-18, ResNet-34, VGG-Net, etc., onto memristor crossbars is challenging due to the line resistance problem limiting crossbar size. This necessitates partitioning full-image convolution into sub-image convolution. To do so, an optimized mapping of memristor crossbars should be considered to divide full-image convolution into multiple crossbars. With limited crossbar resources, especially in edge devices, it is crucial to optimize the crossbar allocation per layer to minimize the hardware resource in term of crossbar area, delay time, and area–delay product. This paper explores three optimization scenarios: (1) optimizing total delay time under a crossbar’s area constraint, (2) optimizing total crossbar area with a crossbar’s delay time constraint, and (3) optimizing a crossbar’s area–delay-time product without constraints. The Lagrange multiplier method is employed for the constrained cases 1 and 2. For the unconstrained case 3, a genetic algorithm (GA) is used to optimize the area–delay-time product. Simulation results demonstrate that the optimization can have significant improvements over the unoptimized results. When VGG-Net is simulated, the optimization can show about 20% reduction in delay time for case 1 and 22% area reduction for case 2. Case 3 highlights the benefits of optimizing the crossbar utilization ratio for minimizing the area–delay-time product. The proposed optimization strategies can substantially enhance the neural network’s performance of memristor crossbar-based processing-in-memory architectures, especially for resource-constrained edge computing platforms.
Reference37 articles.
1. Gradient-based learning applied to document recognition;Lecun;Proc. IEEE,1998
2. Convolutional neural networks for medical image analysis: Full training or fine tuning?;Tajbakhsh;IEEE Trans. Med. Imaging,2016
3. Chauhan, R., Ghanshala, K.K., and Joshi, R.C. (2018, January 15–17). Convolutional neural network (CNN) for image detection and recognition. Proceedings of the 2018 First International Conference on Secure Cyber Computing and Communication (ICSCCC), Jalandhar, India.
4. Recent advances in convolutional neural networks;Gu;Pattern Recognit,2018
5. O’shea, K., and Nash, R. (2015). An introduction to convolutional neural networks. arXiv.