Challenge 2016 sponsoring by
Molecular Devices, LLC.
Challenge 2016 sponsoring by
Double Helix Optics, LLC.

Single-Molecule Localization Microscopy  •  Software Benchmarking

  • Second edition of the challenge in SMLMS 2016

  • Publication of the results in Nature Methods 2015

  • The 2013 Challenge is turned to an online permanent challenge

  • Super-resolution microscopy wins the 2014 Nobel Prize

  • Open software initiative for bioimaging informatics

Benchmarking of SMLM Software

Comprehensive review of the single-molecule localization microscopy (SMLM, PALM, STORM) software packages.
This benchmarking uses common reference datasets that simulates biological structures and image formation process. The evaluation of the software packages is performed with well-defined metrics to get an objective and quantitative assessment. The performance test is mainly done be the developers of the software themselves who participate to a challenge.



First dataset (3D)6 May 2016

The first dataset is released. The same sample is simulated in 4 modalities: 2D, 3D-astigmatism, 3D-biplane, and 3D-double-helix.

Experimental PSF26 April 2016

Released of the first experimental PSF, non-astigmatism, astigmatism, and double-helix.

fight club
26 Feb. 2016

Seamus Holden and Daniel Sage
Nature Photonics 10, 2016, PDF.

New challenge 24 Aug. 2015

A new challenge will be held in August 2016. Send an email to be kept informed.

Publication 15 June 2015

Advanced online publication of the comparative results on the Nature Methods website.

Software 24 Jan. 2015

Update of the comprehensive list of SMLM software packages. 45 for localization software and 6 for deconvolution-type reconstruction software.

Conditions of use 27 Sept. 2014

These reference datasets are designed to be largely used by the developpers to validate theirs software and by the users to check a software. They can be freely used if the sources and references are properly cited.

Online challenge 11 July 2013

The ISBI Challenge is turned to a permanent online challenge.

© 2016 Biomedical Imaging Group, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
Last update: 23 Mar 2016