2019 Model Metrics Challenge Outcomes Now Published

February 4, 2021: The final version of the paper describing the outcomes of the 2019 Model Metrics Challenge is now published in Nature Methods with an accompanying News & Views commentary.

The open access paper, co-authored by all participants, including modelers, assessors, expert advisors, and EMDR team members, provides an overview of the analysis pipeline, the quality of the models submitted, and a careful analysis of the evaluation metrics based on correlation and statistical analyses of the submitted model scores. The paper concludes with recommendations regarding use of the evaluated metrics by individual researchers and structure archives with broad relevance to the cryo-EM and larger scientific communities.