The Analog Formulation of Sparsity Implies Infinite Divisibility and Rules Out Bernoulli-Gaussian Priors

A. Amini, U.S. Kamilov, M. Unser

Proceedings of the 2012 IEEE Information Theory Workshop (ITW'12), Lausanne VD, Swiss Confederation, September 3-7, 2012, pp. 687-691.

Download PDFDownload PS

Motivated by the analog nature of real-world signals, we investigate continuous-time random processes. For this purpose, we consider the stochastic processes that can be whitened by linear transformations and we show that the distribution of their samples is necessarily infinitely divisible. As a consequence, such a modeling rules out the Bernoulli-Gaussian distribution since we are able to show in this paper that it is not infinitely divisible. In other words, while the Bernoulli-Gaussian distribution is among the most studied priors for modeling sparse signals, it cannot be associated with any continuous-time stochastic process. Instead, we propose to adapt the priors that correspond to the increments of compound Poisson processes, which are both sparse and infinitely divisible.

@INPROCEEDINGS(http://bigwww.epfl.ch/publications/amini1203.html,
AUTHOR="Amini, A. and Kamilov, U.S. and Unser, M.",
TITLE="The Analog Formulation of Sparsity Implies Infinite Divisibility
	and Rules Out {B}ernoulli-{G}aussian Priors",
BOOKTITLE="Proceedings of the 2012 {IEEE} Information Theory Workshop
	({ITW'12})",
YEAR="2012",
editor="",
volume="",
series="",
pages="687--691",
address="Lausanne VD, Swiss Confederation",
month="September 3-7,",
organization="",
publisher="",
note="")

DOI: 10.1109/ITW.2012.6404765