Author:
Nagano Yasushi,Hukushima Koji
Abstract
Abstract
This study investigates the effect of the global shrinkage parameter τ of a horseshoe prior, one of the global–local shrinkage priors, on linear regression in sparse signal processing. Statistical mechanics methods are employed to examine the accuracy of signal estimation. The phase diagram of the success and failure of signal recovery in noiseless compressed sensing with varying τ is discussed from the viewpoint of dynamic characterization of approximate message passing (AMP) as a solving algorithm and static characterization of the free-energy landscape. It is found that there exists a parameter region where the AMP algorithm can hardly recover the true signal, even though the true signal is locally stable. The analysis of the free-energy landscape also provides important insight into the optimal choice of τ.
Reference24 articles.
1. Regression shrinkage and selection via the lasso;Tibshirani;J. R. Stat. Soc. B,1996
2. Handling sparsity via the horseshoe;Carvalho,2009
3. The horseshoe estimator for sparse signals;Carvalho;Biometrika,2010
4. Maximum entropy and the nearly black object;Donoho;J. R. Stat. Soc. B,1992