Single-Molecule Localization Microscopy  •  Software Benchmarking

  • Second edition of the challenge presented at SMLMS 2016

  • Special session on YouTube

  • Super-resolution fight club

  • Publication of the results in Nature Methods 2015

  • Challenge 2013 focussed on 2D, low and high density

  • Super-resolution microscopy wins the 2014 Nobel Prize

  • Why Challenges?

Benchmarking of SMLM Software

Comprehensive review of the single-molecule localization microscopy (SMLM, PALM, STORM) software packages.
The benchmarking uses common reference datasets that simulates biological structures and realistic image formation model. The evaluation of the software packages is performed with well-defined metrics to get an objective and quantitative assessment. The performance test is done by the developers themselves who participated to the challenge 2013 or to the challenge 2016.



Second edition of the challenge presented at SMLMS 2016

This edition is focussed on three 3D localization modalities: astigmatism, biplane, or double-helix. The second edition of the challenge held in the Single Molecule Localization Microscopy Symposium (SMLMS) at Lausanne, Switzerland, August 28-30, 2016.

Read more

Special session on YouTube

In the SMLMS symposium, the special session of the Challenge will be live webcasted on a YouTube Channel, Sunday 28 August 2016, 15:00 CEST

View Channel

Super-resolution fight club

News and views of Nature Photonics: Seamus Holden and Daniel Sage Nature Photonics 10, 2016.

This edition will be focussed on both 3D localization techniques. Broad participation is warmly encouraged!

Read full PDF

Publication of the results in Nature Methods 2015

D. Sage, H. Kirshner, T. Pengo, N. Stuurman, J. Min, S. Manley & M. Unser, Quantitative evaluation of software packages for single-molecule localization microscopy, Nature Methods 12, 717–724 (2015).

Read full PDF

Challenge 2013 focussed on 2D, low and high density

The Grand Challenge "Localization Microscopy" was presented as a workshop in the conference IEEE ISBI 2013 at San Francisco. Nearly 30 software have been run, mostly by the authors of the software, thus constituting the first world-wide effort in benchmarking the SMLM software. The results are published in this paper. The challenge is now re-open as a online permanent challenge.

Read more

Super-resolution microscopy wins the 2014 Nobel Prize

Super-resolution fluorescence microscopy is an emerging multidisciplinary field that has opened up new opportunities in studying the living cell at the nanometer scale. It overcomes the classical ...

Read more

Why Challenges?

These challenges are the first attempt to foster the community to use the same common reference datasets to evaluate the performances of the localization software. Collaboration through competition: Nature Methods Editorial, Nature Methods 11, 695 (2014).
Grand Challenge: These SMLM challenges are part of the Grand-Challenge in Biomedical Image Analysis.


Leaderboard11 Nov. 2018

A interactive leaderboard is on-line to explore the results of the assessment across software x modalities x metrics. interactive leaderboard.

Software Directory 11 Jul. 2017

Update of the directory of SMLM software packages. 91 SMLM software are now identified and referred.

Participation1 August 2016

A large panel of software have submitted localization files to the challenge in all modalities.

© 2018 Biomedical Imaging Group, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
Last update: 11 Nov 2018