Graphic STI
logo EPFL
text EPFL
english only
Biomedical Imaging Group
BIG > Research

Home page

News & Events





Tutorials & Reviews

Recent Talks


Download Algorithms

Jobs and Trainees


Student Projects


Variational and Stochastic Splines

Investigators: Sathish Ramani, Shai Tirosh

Summary: We derive an extended family of smoothing-spline estimators for signal denoising and restoration in one and higher dimensions using a variational formulation. We also show that this type of approach is optimal (in the MMSE sense) for the restoration of certain kinds of stochastic processes (including fractal-like signals).


Our basic sampling/reconstruction problem (in one or multiple dimensions) is to recover a continuously defined signal given a series of uniform samples corrupted by additive noise. Depending on the a priori knowledge on the class of signals, there are several alternative ways of approaching this type of problem:

  • the variational (or Tikhonov) formulation;
  • the stochastic (or Wiener) approach, where the goal is to minimize the mean-square estimation error;
  • Bayesian or maximum a posteriori reconstruction.
Interestingly, these formulations all lead to the same kind of solution, which is a generalized smoothing spline.

Main Contributions

Our goal is to extend the concept of a smoothing spline by specifying two types of optimality criteria: variational and stochastic.

  1. Basic Sampling Problem
    In the 1D case, we derived generalized smoothing spline estimators that are associated with a given regularization operator L. We also proposed a stochastic justification by proving that these splines could yield the minimum mean-square error reconstruction of a stationary process whose whitening operator is L. In essence, we end up with an algorithm that can be viewed as a hybrid version of the Wiener filter where the input is discrete (noisy measurements) and the output is a continuously defined function. In particular, we considered the estimation of stochastic signals within the Matérn class which leads to the definition of a new brand of splines.

    In our most recent work, we worked out a similar stochastic interpretation of the more classical polynomial-spline estimators and their fractional extensions. Specifically, we proved that the fractional smoothing-spline estimator with a suitable set of parameters (order of the spline, regularization factor) is statistically optimal in the sense that it provides the minimum mean-square error estimator in the case where the sampled signal is a fractional Brownian motion (fBm) corrupted by additive noise. Note that these fractal processes, which were introduced by Mandelbrot in 1968, are nonstationary and quite delicate to handle rigorously.

    We also investigated a multidimensional version of this problem for the class of images whose power spectrum exhibits a 1⁄f type of decay. We showed that the best linear unbiased estimator is a polyharmonic spline that can be represented as a linear combination of B-spline-like basis functions. We derived the corresponding multidimensional smoothing-spline algorithm and showed that it could be implemented efficiently in the frequency domain. We tested the noise-reduction ability of this estimator on a whole variety of natural and biomedical images and observed that it could be tuned to perform essentially as well as the optimal Wiener filter (oracle solution) that uses the full knowledge of the power spectrum of the noiseless signal. Moreover, we found that the optimal smoothing parameters (smoothing parameter and degree of the spline) could be estimated from the measured data.

  2. Generalized Sampling Problem
    We can also make the model more realistic by including the blurring effect of the acquisition device. This too yields a generalized class of spline-like estimators that can be implemented by filtering. The main point is that the optimal solutions (variational or stochastic) are generally not bandlimited.

Collaborations: Prof. Michael Unser, Dr. Thierry Blu, Dr. Dimitri Van De Ville

Period: 2002-2009

Funding: Grants 200020-101821 and 200020-109415 from the Swiss National Science Foundation

Major Publication


S. Ramani, D. Van De Ville, T. Blu, M. Unser, "Nonideal Sampling and Regularization Theory," IEEE Transactions on Signal Processing, vol. 56, no. 3, pp. 1055-1070, March 2008.


T. Blu, M. Unser, "Self-Similarity: Part II—Optimal Estimation of Fractal Processes," IEEE Transactions on Signal Processing, vol. 55, no. 4, pp. 1364-1378, April 2007.


S. Tirosh, D. Van De Ville, M. Unser, "Polyharmonic Smoothing Splines and the Multidimensional Wiener Filtering of Fractal-Like Signals," IEEE Transactions on Image Processing, vol. 15, no. 9, pp. 2616-2630, September 2006.


S. Ramani, M. Unser, "Matérn B-Splines and the Optimal Reconstruction of Signals," IEEE Signal Processing Letters, vol. 13, no. 7, pp. 437-440, July 2006.


S. Ramani, D. Van De Ville, M. Unser, "Non-Ideal Sampling and Adapted Reconstruction Using the Stochastic Matérn Model," Best student paper award, Proceedings of the IEEE Thirty-First International Conference on Acoustics, Speech, and Signal Processing (ICASSP'06), Toulouse, France, May 14-19, 2006, pp. II-73-II-76.


M. Unser, T. Blu, "Generalized Smoothing Splines and the Optimal Discretization of the Wiener Filter," IEEE Transactions on Signal Processing, vol. 53, no. 6, pp. 2146-2159, June 2005.


M. Unser, T. Blu, "A Unifying Spline Formulation for Stochastic Signal Processing [Or How Schoenberg Meets Wiener, with the Help of Tikhonov]," Plenary talk, Second International Conference on Computational Harmonic Analysis, Nineteenth Annual Shanks Lecture (CHA'04), Nashville TN, USA, May 24-30, 2004.


S. Ramani, D. Van De Ville, M. Unser, "Sampling in Practice: Is the Best Reconstruction Space Bandlimited?," Proceedings of the 2005 IEEE International Conference on Image Processing (ICIP'05), Genova, Italy, September 11-14, 2005, pp. II-153-II-156.

Related Topics

© 2022 EPFL • • 11.08.2022