ReSta: Recovery of Accuracy During Training of Deep Learning Models in a 14-nm Technology-Based ReRAM Array

Abstract

In this article, we propose an electrical bias technique to recover the accuracy of a degraded -based resistive random access memory (ReRAM) array in deep neural network (DNN) training. We simulate degradation through the application of pulses having high pulse amplitude, resulting in a fatigued ReRAM array that fails to converge during training. We propose a novel technique, recovery stabilization (ReSta), which can recover the array accuracy up to the level it was before the fatigue was introduced. After using the proposed controlled recovery technique, we obtain an accuracy of 98% on the reduced Modified National Institute of Standard and Technology (MNIST) classification task, approaching a floating point baseline. This work demonstrates a viable pathway to recover the performance of the fatigued ReRAM crossbar arrays in in-memory DNN training.