generate_data.Heatmaps {IOHanalyzer}

Nevergrad-dashboard based algorithm comparison

Description

This procedure calculates the fraction of times algorithm A is better than algorithm B according to their mean on each function,dimension,target tuple

Usage

generate_data.Heatmaps(dsList, which = "by_FV", target_dt = NULL)

Arguments

dsList

The DataSetList, can contain multiple functions and dimensions, but should have the same algorithms for all of them. For functions/dimensions where this is not the case, all algorithms are considered tied.

which

Whether to use fixed-target ('by_FV') or fixed-budget ('by_RT') perspective

target_dt

Custom data.table target value to use. When NULL, this is selected automatically.

Value

A matrix containing the pairwise win-ratios.

Examples

generate_data.Heatmaps(dsl)
generate_data.Heatmaps(dsl, which = 'by_RT')