How to assess and report the performance of a stochastic algorithm on a benchmark problem: mean or best result on a number of runs? |
| |
| Authors: | Mauro Birattari Marco Dorigo |
| |
| Institution: | (1) IRIDIA-CoDE, Université Libre de Bruxelles, Brussels, Belgium |
| |
| Abstract: | Some authors claim that reporting the best result obtained by a stochastic algorithm in a number of runs is more meaningful
than reporting some central statistic. In this short note, we analyze and refute the main argument brought in favor of this
statement. |
| |
| Keywords: | Assessment of performance Experimental methodology Stochastic algorithms Metaheuristics |
| 本文献已被 SpringerLink 等数据库收录！ |
