Defining and Benchmarking Open Problems in Single-Cell Analysis

Malte Luecken, Scott Gigante, Daniel Burkhardt, Robrecht Cannoodt, Daniel Strobl, Nikolay Markov, Luke Zappia, Giovanni Palla, Wesley Lewis, Daniel Dimitrov, Michael Vinyard, Daniel Magruder, Alma Andersson, Emma Dann, Qian Qin, Dominik Otto, Michal Klein, Olga Botvinnik, Louise Deconinck, Kai Waldrant, Bastian Rieck, Constantin Ahlmann-Eltze, Eduardo Da Veiga Beltrame, Andrew Benz, Carmen Bravo González-Blas, Ann Chen, Benjamin DeMeo, Can Ergen, Swann Floc'hlay, Adam Gayoso, Stephanie Hicks, Yuge Ji, Vitalii Kleshchevnikov, Gioele La Manno, Maximilian Lombardo, Romain Lopez, Dario Righelli, Hirak Sarkar, Valentine Svensson, Alex Tong, Galen Xing, Chenling Xu, Jonathan Bloom, Angela Pisco, Julio Saez-Rodriguez, Drausin Wulsin, Luca Pinello, Yvan Saeys, Fabian Theis, Smita Krishnaswamy
April, 2024
Cite DOI URL

Abstract

With the growing number of single-cell analysis tools, benchmarks are increasingly important to guide analysis and method development. However, a lack of standardisation and extensibility in current benchmarks limits their usability, longevity, and relevance to the community. We present Open Problems, a living, extensible, community-guided benchmarking platform including 10 current single-cell tasks that we envision will raise standards for the selection, evaluation, and development of methods in single-cell analysis.

Type
Preprint
Publication
Preprint
Alex Tong
Alex Tong
Postdoctoral Fellow

My research interests include flow models and optimal transport applied to cells and proteins.