Domain Adaptation and Transfer Learning in StochasticNets

Abstract

<p>Transfer learning is a recent field of machine learning research that<br />aims to resolve the challenge of dealing with insufficient training<br />data in the domain of interest. This is a particular issue with traditional<br />deep neural networks where a large amount of training<br />data is needed. Recently, StochasticNets was proposed to take<br />advantage of sparse connectivity in order to decrease the number<br />of parameters that needs to be learned, which in turn may relax<br />training data size requirements. In this paper, we study the efficacy<br />of transfer learning on StochasticNet frameworks. Experimental results<br />show 7% improvement on StochasticNet performance when<br />the transfer learning is applied in training step.</p>