Neue Suche
Arbeitspapier / Forschungsbericht | Open Access

Benchmarking in Optimization : (Best Practice and Open Issues)

Autor*innen
Bartz-Beielstein, Thomas ; Doerr, Carola ; Bossek, Jakob ; Chandrasekaran, Sowmya ; Eftimov, Tome ; Fischbach, Andreas ; Kerschke, Pascal ; Lopez-Ibanez, Manuel ; Malan, Katherine M. ; Moore, Jason H. ; Naujoks, Boris ; Orzechowski, Patryk ; Volz, Vanessa ; Wagner, Markus ; Weise, Thomas
Verlag
Technische Hochschule Köln 
URN
urn:nbn:de:hbz:832-cos4-9022

Weitere Details

Sprache
englisch
Darstellungsform
Text

This survey compiles ideas and recommendations from more than a dozen researchers with different backgrounds and from different institutes around the world. Promoting best practice in benchmarking is its main goal. The article discusses eight essential topics in benchmarking: clearly stated goals, well- specified problems, suitable algorithms, adequate performance measures, thoughtful analysis, effective and efficient designs, comprehensible presentations, and guaranteed reproducibility. The final goal is to provide well-accepted guidelines (rules) that might be useful for authors and reviewers. As benchmarking in optimization is an active and evolving field of research this manuscript is meant to co-evolve over time by means of periodic updates.

Zitierstile

Download
 RDF/XML-Format
 JSON-LD-Format
 Turtle-Format
 N3-Format