R: Evaluate a metric on each protected subgroup in a task.

groupwise_metrics {mlr3fairness}

R Documentation

Evaluate a metric on each protected subgroup in a task.

Description

Instantiates one new measure per protected attribute group in a task. Each metric is then evaluated only on predictions made for the given specific subgroup.

Usage

groupwise_metrics(base_measure, task, intersect = TRUE)

Arguments

`base_measure`	(`Measure()`) The base metric evaluated within each subgroup.
`task`	`Task` `mlr3::Task()` to instantiate measures for.
`intersect`	`logical` Should multiple pta groups be intersected? Defaults to `TRUE`. Only relevant if more than one `pta` columns are provided.

Value

list
List of mlr3::Measures.

Examples

  library("mlr3")
  t = tsk("compas")
  l = lrn("classif.rpart")
  m = groupwise_metrics(msr("classif.acc"), t)
  l$train(t)$predict(t)$score(m, t)