How to assess and report the performance of a stochastic algorithm on a benchmark problem: mean or best result on a number of runs? |
| |
Authors: | Mauro Birattari Marco Dorigo |
| |
Affiliation: | (1) IRIDIA-CoDE, Université Libre de Bruxelles, Brussels, Belgium |
| |
Abstract: | Some authors claim that reporting the best result obtained by a stochastic algorithm in a number of runs is more meaningful than reporting some central statistic. In this short note, we analyze and refute the main argument brought in favor of this statement. |
| |
Keywords: | Assessment of performance Experimental methodology Stochastic algorithms Metaheuristics |
本文献已被 SpringerLink 等数据库收录! |