A linear compensation method for inference accuracy improvement of memristive in-memory computing

Abstract

Abstract Memristive computing system (MCS), with the feature of in-memory computing capability, for artificial neural networks (ANNs) deployment showing low power and massive parallelism, is a promising alternative for traditional Von-Neumann architecture computing system. However, because of the various non-idealities of both peripheral circuits and memristor array, the performance of the practical MCS tends to be significantly reduced. In this work, a linear compensation method (LCM) is proposed for the performance improvement of MCS under the effect of non-idealities. By considering the effects of various non-ideal states in the MCS as a whole, the output error of the MCS under different conditions is investigated. Then, a mathematic model for the output error is established based on the experimental data. Furthermore, the MCS is researched at the physical circuit level as well, in order to analyze the specific way in which the non-idealities affect the output current. Finally, based on the established mathematical model, the LCM output current is compensated in real time to improve the system performance. The effectiveness of LCM is verified and showing outstanding performance in the residual neural network-34 network architecture, which is easily affected by the non-idealities in hardware. The proposed LCM can be naturally integrated into the operation processes of MCS, paving the way for optimizing the deployment on generic ANN hardware based on the memristor.