EPFL | Biomedical Imaging Group

Machine Learning in Microscopy—Insights, Opportunities and Challenges

I. Cunha, E. Latron, S. Bauer, D. Sage, J. Griffié

Journal of Cell Science, vol. 137, no. 20, October 28, 2024.

Machine learning (ML) is transforming the field of image processing and analysis, from automation of laborious tasks to open-ended exploration of visual patterns. This has striking implications for image-driven life science research, particularly microscopy. In this Review, we focus on the opportunities and challenges associated with applying ML-based pipelines for microscopy datasets from a user point of view. We investigate the significance of different data characteristics—quantity, transferability and content—and how this determines which ML model(s) to use, as well as their output(s). Within the context of cell biological questions and applications, we further discuss ML utility range, namely data curation, exploration, prediction and explanation, and what they entail and translate to in the context of microscopy. Finally, we explore the challenges, common artefacts and risks associated with ML in microscopy. Building on insights from other fields, we propose how these pitfalls might be mitigated for in microscopy.

@ARTICLE(http://bigwww.epfl.ch/publications/cunha2401.html,
AUTHOR="Cunha, I. and Latron, E. and Bauer, S. and Sage, D. and
	Griffi{\'{e}}, J.",
TITLE="Machine Learning in Microscopy---Insights, Opportunities and
	Challenges",
JOURNAL="Journal of Cell Science",
YEAR="2024",
volume="137",
number="20",
pages="",
month="October 28,",
note="")

© 2024 The Company of Biologists Ltd.. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from The Company of Biologists Ltd.. This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.