model_performance: Create Model Performance Explanation

In auditor: Model Audit - Verification, Validation, and Error Analysis

Create Model Performance Explanation

Description

Creates auditor_model_performance object that can be used to plot radar with ranking of models.

Usage

model_performance(
  object,
  score = c("mae", "mse", "rec", "rroc"),
  new_score = NULL,
  data = NULL,
  ...
)

modelPerformance(
  object,
  score = c("mae", "mse", "rec", "rroc"),
  new_score = NULL
)

Arguments

object	An object of class explainer created with function explain from the DALEX package.
score	Vector of score names to be calculated. Possible values: acc, auc, cookdistance, dw, f1, gini, halfnormal, mae, mse, peak, precision, r2, rec, recall, rmse, rroc, runs, specificity, one_minus_acc, one_minus_auc, one_minus_f1, one_minus_gini, one_minus_precision, one_minus_recall, one_minus_specificity (for detailed description see functions in see also section). Pass NULL if you want to use only custom scores by new_score parameter.
new_score	A named list of functions that take one argument: object of class 'explainer' and return a numeric value. The measure calculated by the function should have the property that lower score value indicates better model.
data	New data that will be used to calculate scores. Pass NULL if you want to use data from object.
...	Other arguments dependent on the score list.

Value

An object of the class auditor_model_performance.

See Also

score_acc, score_auc, score_cooksdistance, score_dw, score_f1, score_gini, score_halfnormal, score_mae, score_mse, score_peak, score_precision, score_r2, score_rec, score_recall, score_rmse, score_rroc, score_runs, score_specificity, score_one_minus_acc, score_one_minus_auc, score_one_minus_f1, score_one_minus_precision, score_one_minus_gini, score_one_minus_recall, score_one_minus_specificity

Examples

data(titanic_imputed, package = "DALEX")

# fit a model
model_glm <- glm(survived ~ ., family = binomial, data = titanic_imputed)

# use DALEX package to wrap up a model into explainer
glm_audit <- audit(model_glm,
                   data = titanic_imputed,
                   y = titanic_imputed$survived)

# validate a model with auditor
library(auditor)
mp <- model_performance(glm_audit)
mp

plot(mp)

auditor documentation built on Nov. 2, 2023, 6:13 p.m.