Graphic STI
logo EPFL
text EPFL
english only
Biomedical Imaging Group
Research
BIG > Research
CONTENTS

Home page

News & Events

Seminars

People

Research

Publications

Tutorials & Reviews

Recent Talks

Demos

Download Algorithms

Jobs and Trainees

Teaching

Student Projects

Intranet

Image Registration

Investigators: Phlippe Thévenaz, Slavica Jonić, Carlos Óscar Sánchez Sorzano

Summary: We have designed algorithms for a variety of image registration tasks (e.g., intra or inter-modal rigid-body, 2D to 3D, elastic, and mosaicking). They take advantage of a high-quality spline representation of the image data, and of a coarse-to-fine optimization strategy to estimate the parameters of the deformation map.

Introduction

Registration refers to the process of bringing a source image (or volume) into correspondence with a reference one. There are various forms of registration that are needed for biomedical imaging; they differ in the type of transformation used (e.g., rigid body vs. elastic) and the criterion that is optimized (e.g., least squares vs. mutual information). The applications are numerous: noise reduction by correlation-averaging of high-resolution electron micrographs; 3D reconstruction from histological sections; motion compensation in MRI; multimodal imaging of the brain; creation of a mosaic of overlapping small image tiles. Registration is also becoming increasingly important in digital radiology, where it is of interest to compare images from the same patient acquired at different times (e.g., before, and after treatment).

Main Contributions

Over the years, we have designed a variety of image registration algorithms:

  • Intramodal, rigid-body or affine: this basic algorithm is best suited for precise (e.g., sub-pixel) motion compensation.
  • Intermodal, rigid-body or affine: this method uses "mutual information" and is designed to align images of the same patient obtained from different modalities (e.g., MRI, CT, PET).
  • 2D-to-3D, rigid body: this method estimates the 3D pose of an object by matching a set of 2D projections (radiographs) to a reference 3D volume.
  • Intramodal, elastic: the source image is geometrically transformed to best match the reference. The free-form deformation is represented in a B-spline basis.
  • Intramodal, mosaicking: given a collection of partially overlapping tiles, we propose an efficient strategy to select which pairs to register in order to create a mosaic.
All approaches are parametric in the sense that the geometrical transformation is represented by a small number of parameters (e.g., translation vector and Euler angles for a rigid-body transformation, or a set of control points [or B-spline coefficients] for a free-form deformation). In all cases, we use a multiresolution optimization strategy that is particularly efficient with respect to both computation time and robustness. The clever use of spline functions result in precise registration; they play a role in the continuous representation of images, the Parzen-based estimation of joint histograms, and the parametrization of free-form deformations.

These methods require the development of special-purpose optimization algorithms that are capable of super-linear convergence when sufficiently close to the optimum. This is essential if one wants to take full advantage of a coarse-to-fine iteration strategy in which the current solution is propagated to the next finer scale.

We have also investigated the impact of the criterion that is used to drive the registration. We have proposed vector-spline regularization to combine an image-driven criterion with a landmark-driven one; the novelty of this contribution is that the resulting regularization fully takes into account the vectorial nature of the deformation, including cross terms. In the context of mutual information, we have proposed that the criterion be computed out of discrete data samples that follow a Halton distribution; when computed this way, mutual information exhibits a much lesser tendency to align the transformation with the grid of pixels than with methods based on regular sampling.

Collaboration: Prof. Michael Unser

Period: 1997-ongoing

Major Publications

[1] 

P. Thévenaz, U.E. Ruttimann, M. Unser, "A Pyramid Approach to Subpixel Registration Based on Intensity," IEEE Transactions on Image Processing, vol. 7, no. 1, pp. 27-41, January 1998.

[2] 

P. Thévenaz, M. Unser, "Optimization of Mutual Information for Multiresolution Image Registration," IEEE Transactions on Image Processing, vol. 9, no. 12, pp. 2083-2099, December 2000.

[3] 

J. Kybic, P. Thévenaz, A. Nirkko, M. Unser, "Unwarping of Unidirectionally Distorted EPI Images," IEEE Transactions on Medical Imaging, vol. 19, no. 2, pp. 80-93, February 2000.

[4] 

J. Kybic, M. Unser, "Fast Parametric Elastic Image Registration," IEEE Transactions on Image Processing, vol. 12, no. 11, pp. 1427-1442, November 2003.

[5] 

S. Jonić, P. Thévenaz, M. Unser, "Multiresolution-Based Registration of a Volume to a Set of Its Projections," Proceedings of the SPIE International Symposium on Medical Imaging: Image Processing (MI'03), San Diego CA, USA, February 17-20, 2003, vol. 5032, part II, pp. 1049-1052.

[6] 

C.Ó. Sánchez Sorzano, P. Thévenaz, M. Unser, "Elastic Registration of Biological Images Using Vector-Spline Regularization ," IEEE Transactions on Biomedical Engineering, vol. 52, no. 4, pp. 652-663, April 2005.

[7] 

S. Jonić, C.Ó. Sánchez Sorzano, P. Thévenaz, C. El-Bez, S. De Carlo, M. Unser, "Spline-Based Image-to-Volume Registration for Three-Dimensional Electron Microscopy," Ultramicroscopy, vol. 103, no. 4, pp. 303-317, July 2005.

[8] 

M.J. Ledesma-Carbayo, J. Kybic, M. Desco, A. Santos, M. Sühling, P. Hunziker, M. Unser, "Spatio-Temporal Nonrigid Registration for Ultrasound Cardiac Motion Estimation," IEEE Transactions on Medical Imaging, vol. 24, no. 9, pp. 1113-1126, September 2005.

[9] 

S. Jonić, C.Ó. Sánchez Sorzano, P. Thévenaz, C. El-Bez, S. De Carlo, M. Unser, "Spline-Based Image-to-Volume Registration for Three-Dimensional Electron Microscopy," Ultramicroscopy, vol. 103, no. 4, pp. 303-317, July 2005.

[10] 

S. Jonić, P. Thévenaz, G. Zheng, L.-P. Nolte, M. Unser, "An Optimized Spline-Based Registration of a 3D CT to a Set of C-Arm Images," International Journal of Biomedical Imaging, vol. 2006, ID 47197, 2006.

[11] 

P. Thévenaz, M. Unser, "User-Friendly Semiautomated Assembly of Accurate Image Mosaics in Microscopy," Microscopy Research and Technique, vol. 70, no. 2, pp. 135-146, February 2007.

[12] 

C.Ó.S. Sorzano, I. Arganda-Carreras, P. Thévenaz, A. Beloso, G. Morales, I. Valdés, C. Pérez-García, C. Castillo, E. Garrido, M. Unser, "Elastic Image Registration of 2-D Gels for Differential and Repeatability Studies," Proteomics, vol. 8, no. 1, pp. 62-65, January 2008.

[13] 

P. Thévenaz, M. Bierlaire, M. Unser, "Halton Sampling for Image Registration Based on Mutual Information," Sampling Theory in Signal and Image Processing, vol. 7, no. 2, pp. 141-171, May 2008.

[14] 

I. Arganda-Carreras, C.Ó.S. Sorzano, P. Thévenaz, A. Muñoz Barrutia, J. Kybic, R. Marabini, J.M. Carazo, C. Ortiz de Solórzano, "Non-Rigid Consistent Registration of 2D Image Sequences," Physics in Medicine and Biology, vol. 55, no. 20, pp. 6215-6242, October 2010.

Related Topics

© 2013 EPFL • webmaster.big@epfl.ch • 16.12.2013