Affiliation:
1. University of Portsmouth
2. Czestochowa University of Technology
Abstract
Abstract
Optimising the discrete convolution operations is important due to the fast growing interest and successful applications of deep learning to various fields and industries. In response to that, we propose an algorithm that views the 2D convolution operation between matrices as a matrix multiplication that involves a Toeplitz matrix; our algorithm is based on the mathematical result that we prove. We will present the complexity of the resulting algorithm and benchmark it against other 2D convolution algorithms in known Python computational libraries. The current implementations of our algorithm suggest a potential speed-up of convolution operation if the sparsity of the Toeplitz matrix was utilised.
Publisher
Research Square Platform LLC
Reference57 articles.
1. A. Krizhevsky and I. Sutshever and G. Hinton (2012) ImageNet classification with deep convolutional neural networks. In Proc. 26th Annual Conf. on Neural Information Processing Systems (3--5): 1090-1098
2. Szegedy, Christian and Wei Liu and Yangqing Jia and Sermanet, Pierre and Reed, Scott and Anguelov, Dragomir and Erhan, Dumitru and Vanhoucke, Vincent and Rabinovich, Andrew (2015) Going deeper with convolutions. 10.1109/CVPR.2015.7298594, 1-9, , , 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
3. Valimaki, Vesa and Parker, Julian D. and Savioja, Lauri and Smith, Julius O. and Abel, Jonathan S. (2012) Fifty Years of Artificial Reverberation. IEEE Transactions on Audio, Speech, and Language Processing 20(5): 1421-1448 https://doi.org/10.1109/TASL.2012.2189567
4. Abdel-Hamid, Ossama and Mohamed, Abdel-rahman and Jiang, Hui and Deng, Li and Penn, Gerald and Yu, Dong (2014) Convolutional Neural Networks for Speech Recognition. IEEE/ACM Transactions on Audio, Speech, and Language Processing 22(10): 1533-1545 https://doi.org/10.1109/TASLP.2014.2339736
5. Wang, Wei and Gang, Jianxun (2018) Application of Convolutional Neural Network in Natural Language Processing. 10.1109/ICISCAE.2018.8666928, 64-70, , , 2018 International Conference on Information Systems and Computer Aided Education (ICISCAE)
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献