generate_data.Heatmaps: Nevergrad-dashboard based algorithm comparison

In IOHanalyzer: Data Analysis Part of 'IOHprofiler'

Nevergrad-dashboard based algorithm comparison

Description

This procedure calculates the fraction of times algorithm A is better than algorithm B according to their mean on each function,dimension,target tuple

Usage

generate_data.Heatmaps(dsList, which = "by_FV", target_dt = NULL)

Arguments

dsList	The DataSetList, can contain multiple functions and dimensions, but should have the same algorithms for all of them. For functions/dimensions where this is not the case, all algorithms are considered tied.
which	Whether to use fixed-target ('by_FV') or fixed-budget ('by_RT') perspective
target_dt	Custom data.table target value to use. When NULL, this is selected automatically.

Value

A matrix containing the pairwise win-ratios.

Examples

generate_data.Heatmaps(dsl)
generate_data.Heatmaps(dsl, which = 'by_RT')

IOHanalyzer documentation built on May 29, 2024, 9:39 a.m.