groupwise_metrics: Evaluate a metric on each protected subgroup in a task.

In mlr3fairness: Fairness Auditing and Debiasing for 'mlr3'

Evaluate a metric on each protected subgroup in a task.

Description

Instantiates one new measure per protected attribute group in a task. Each metric is then evaluated only on predictions made for the given specific subgroup.

Usage

groupwise_metrics(base_measure, task, intersect = TRUE)

Arguments

base_measure	(Measure()) The base metric evaluated within each subgroup.
task	Task mlr3::Task() to instantiate measures for.
intersect	logical Should multiple pta groups be intersected? Defaults to TRUE. Only relevant if more than one pta columns are provided.

Value

list
List of mlr3::Measures.

See Also

MeasureSubgroup

Examples

  library("mlr3")
  t = tsk("compas")
  l = lrn("classif.rpart")
  m = groupwise_metrics(msr("classif.acc"), t)
  l$train(t)$predict(t)$score(m, t)

mlr3fairness documentation built on May 31, 2023, 7:22 p.m.