Neural Network Based Black-box Estimator of Mutual Information

Abstract

We show that neural networks with softmax outputs are capable of estimating a lower bound on the mutual information of memoryless communication channels without prior knowledge of the channel properties.