Biomedical Imaging GroupSTI
English only   BIG > Publications > AR(1) Processes

 Home Page
 News & Events
 Tutorials and Reviews
 Download Algorithms

 All BibTeX References

On the Optimality of Operator-Like Wavelets for Sparse AR(1) Processes

P. Pad, M. Unser

Proceedings of the Thirty-Eighth IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP'13), Vancouver BC, Canada, May 26-31, 2013, pp. 5598-5602.

Sinusoidal transforms such as the DCT are known to be optimal—that is, asymptotically equivalent to the Karhunen-Loève transform (KLT)—for the representation of Gaussian stationary processes, including the classical AR(1) processes. While the KLT remains applicable for non-Gaussian signals, it loses optimality and, is outperformed by the independent-component analysis (ICA), which aims at producing the most-decoupled representation. In this paper, we consider an extension of the classical AR(1) model that is driven by symmetric-alpha-stable (SαS) noise which is either Gaussian (α = 2) or sparse (0 < α < 2). For the sparse (non-Gaussian) regime, we prove that an expansion in a proper wavelet basis (including the Haar transform) is much closer to the optimal orthogonal ICA solution than the classical Fourier-type representations. Our criterion for optimality, which favors independence, is the Kullback-Leibler divergence between the joint pdf of the original signal and the product of the marginals in the transformed domain. We also observe that, for very sparse AR(1) processes (α ≤ 1), the operator-like wavelet transform is indistinguishable from the ICA solution that is determined through numerical optimization.

AUTHOR="Pad, P. and Unser, M.",
TITLE="On the Optimality of Operator-Like Wavelets for Sparse {AR(1)}
BOOKTITLE="Proceedings of the Thirty-Eighth {IEEE} International
        Conference on Acoustics, Speech, and Signal Processing
address="Vancouver BC, Canada",
month="May 26-31,",

© 2013 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from IEEE.
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.