EPFL | Biomedical Imaging Group | Regularization Theory

Nonideal Sampling and Regularization Theory

S. Ramani, D. Van De Ville, T. Blu, M. Unser

IEEE Transactions on Signal Processing, vol. 56, no. 3, pp. 1055-1070, March 2008.

Shannon's sampling theory and its variants provide effective solutions to the problem of reconstructing a signal from its samples in some “shift-invariant” space, which may or may not be bandlimited. In this paper, we present some further justification for this type of representation, while addressing the issue of the specification of the best reconstruction space. We consider a realistic setting where a multidimensional signal is prefiltered prior to sampling, and the samples are corrupted by additive noise. We adopt a variational approach to the reconstruction problem and minimize a data fidelity term subject to a Tikhonov-like (continuous domain) L₂-regularization to obtain the continuous-space solution. We present theoretical justification for the minimization of this cost functional and show that the globally minimal continuous-space solution belongs to a shift-invariant space generated by a function (generalized B-spline) that is generally not bandlimited. When the sampling is ideal, we recover some of the classical smoothing spline estimators. The optimal reconstruction space is characterized by a condition that links the generating function to the regularization operator and implies the existence of a B-spline-like basis. To make the scheme practical, we specify the generating functions corresponding to the most popular families of regularization operators (derivatives, iterated Laplacian), as well as a new, generalized one that leads to a new brand of Matérn splines.We conclude the paper by proposing a stochastic interpretation of the reconstruction algorithm and establishing an equivalence with the minimax and minimum mean square error (MMSE/Wiener) solutions of the generalized sampling problem.

@ARTICLE(http://bigwww.epfl.ch/publications/ramani0801.html,
AUTHOR="Ramani, S. and Van De Ville, D. and Blu, T. and Unser, M.",
TITLE="Nonideal Sampling and Regularization Theory",
JOURNAL="{IEEE} Transactions on Signal Processing",
YEAR="2008",
volume="56",
number="3",
pages="1055--1070",
month="November",
note="")

© 2008 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from IEEE. This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.