score_runs: Runs Score

In auditor: Model Audit - Verification, Validation, and Error Analysis

Runs Score

Description

Score based on Runs test statistic. Note that this test is not very strong. It utilizes only signs of the residuals. The score value is helpful in comparing models. It is worth pointing out that results of tests like p-value makes sense only when the test assumptions are satisfied. Otherwise test statistic may be considered as a score.

Usage

score_runs(object, variable = NULL, data = NULL, y = NULL, ...)

scoreRuns(object, variable = NULL)

Arguments

object	An object of class explainer created with function explain from the DALEX package.
variable	name of model variable to order residuals.
data	New data that will be used to calculate the score. Pass NULL if you want to use data from object.
y	New y parameter will be used to calculate score.
...	Other arguments dependent on the type of score.

Value

An object of class auditor_score.

Examples

dragons <- DALEX::dragons[1:100, ]

# fit a model
model_lm <- lm(life_length ~ ., data = dragons)

# create an explainer
lm_audit <- audit(model_lm, data = dragons, y = dragons$life_length)

# caluclate score
score_runs(lm_audit)

auditor documentation built on Nov. 2, 2023, 6:13 p.m.