Biomedical Imaging GroupSTI
English only   BIG > Publications > Sparse Processes

 Home Page
 News & Events
 Tutorials and Reviews
 Download Algorithms

 All BibTeX References

Sparse Stochastic Processes: A Unifying Statistical Framework for Modern Image Processing

M. Unser

Tutorial, 2015 IEEE International Conference on Image Processing (ICIP'15), Québec QC, Canada, September 27-30, 2015, TPM-T5.

Sparsity and compressed sensing are very popular topics in image processing. More and more, researchers are relying on the related l1-type minimization schemes to solve a variety of ill-posed problems in imaging. The paradigm is well established with a solid mathematical foundation, although the arguments that have been put forth in the past are mostly deterministic. In this tutorial, we shall introduce the participants to the statistical side of this story. As an analogy, think of the foundational role of Gaussian stationary processes: these justify the use of the Fourier transform or DCT and lend themselves to the formulation of MMSE/MAP estimators based on the minimization of quadratic functionals.

The relevant objects here are sparse stochastic processes (SSP), which are continuous-domain processes that admit a parsimonious representation in a matched wavelet-like basis. Thus, they exhibit the kind of sparse behavior that has been exploited by researchers in recent years for designing second-generation algorithms for image compression (JPEG 2000), compressed sensing, and the solution of ill-posed inverse problems (l1 vs. l2 minimization).

The construction of SSPs is based on an innovation model that is an extension of the classical filtered-white- noise representation of a Gaussian stationary process. In a nutshell, the idea is to replace 1) the traditional white Gaussian noise by a more general continuous-domain entity (Lévy innovation) and 2) the shaping filter by a more general linear operator. We shall present the functional tools for the complete characterization of these generalized processes and the determination of their transform-domain statistics. We shall also describe self-similar models (non-Gaussian variants of fBm) that are well suited for image processing.

We shall then apply those models to the derivation of statistical algorithms for solving ill-posed problems in imaging. This allows for a reinterpretation of popular sparsity-promoting processing schemes—such as total-variation denoising, LASSO, and wavelet shrinkage—as MAP estimators for specific types of SSPs. It also suggests novel alternative Bayesian recovery procedures that minimize the estimation error (MMSE solution). The concepts will be illustrated with concrete examples of sparsity-based image processing including denoising, deconvolution, tomography, and MRI reconstruction from non-Cartesian k-space samples.

AUTHOR="Unser, M.",
TITLE="Sparse Stochastic Processes: {A} Unifying Statistical Framework
        for Modern Image Processing",
BOOKTITLE="2015 {IEEE} International Conference on Image Processing
address="Qu{\'{e}}bec QC, Canada",
month="September 27-30,",

© 2015 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from IEEE.
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.