EPFL | Biomedical Imaging Group | Microscopy Benchmark

Challenge for Benchmarking Single-Molecule Localization Microscopy Software Packages

D. Sage

Sixth Single Molecule Localization Microscopy Symposium (SMLMS'16), Lausanne VD, Swiss Confederation, August 28-30, 2016.

We present the second edition of the SMLM software challenge. In this 2016 edition, we are focusing on the three 3D techniques allowing 3D reconstruction of super-resolved images: biplane, astigmatic lens, or double helix. 3D localization microscopy is one of the key areas of growth in the field but still the algorithmic aspects of 3D SMLM are largely unexplored and have never been benchmarked.

Here, we discuss the perspectives of the challenge and the technical aspects of the organization. The key of the challenge is that the authors of the software run the experiment by themselves. We first established a group of experts helping to prepare relevant datasets by simulating the image formation of the microscopy. In this edition, we chose 3D experimental point-spread functions (PSF) to better reproduce experimental conditions. We defined the objective metrics to assess the performance of the software in terms of detection rate, lateral and axial accuracies, resolution, computation time, usability and accessibility. Finally, so, we have encouraged people to take part to the challenge.

At this date, we have attracted the attention of large number of participants, with over 30 software will be evaluated. Based on the submission of the participants, we expose also the preliminary results of our comparative study for 3D localization software packages.

@INPROCEEDINGS(http://bigwww.epfl.ch/publications/sage1602.html,
AUTHOR="Sage, D.",
TITLE="Challenge for Benchmarking Single-Molecule Localization
	Microscopy Software Packages",
BOOKTITLE="Sixth Single Molecule Localization Microscopy Symposium
	({SMLMS'16})",
YEAR="2016",
editor="",
volume="",
series="",
pages="",
address="Lausanne VD, Swiss Confederation",
month="August 28-30,",
organization="",
publisher="",
note="")

© 2016 EPFL. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from EPFL. This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.