Map Challenge Assessment Phase is Now Open

The Assessment Phase of the Map Challenge is now officially open, and all are welcome to participate.

The Challenge Phase (July 2015-Apr 2016) was a tremendous success, with 66 submitted maps spread across the 7 image data benchmark targets. We recognize the significant time commitment required and are grateful to the 27 challengers who contributed their efforts and made their results available for analysis.

Following review, the challenge data and files are now publicly available to assessors.  The authors of the entries and the software used have been suppressed to promote a blind assessment. We welcome input from the assessors as to how to most usefully evaluate these results.  For example, assessment/comparison methods could include statistical analyses, resolution estimation, or fitting of atomic models. Some suggestions are provided on the website but these are not meant to be prescriptive. 

During this next phase, assessors are strongly encouraged to share their plans and submit short summaries of their results.  We will end the blind assessment phase in mid February 2017. We then plan to present and discuss the results of the assessment more fully at a workshop currently proposed for some time in Spring 2017.  Our goal is also to solicit manuscript submissions for a special issue to a suitable journal.

Please visit the map challenge overview page for more information and participation links.