clstats: Class detection quality.

In PiotrTymoszuk/caretExtra: Extra functionality for predictions and quality control of caret models

Class detection quality.

Description

Computes a bunch of numeric statistics for quality of identification of particular classes in an one versus rest manner.

Usage

clstats(x, ...)

## S3 method for class 'predx'
clstats(x, ...)

## S3 method for class 'caretx'
clstats(x, newdata = NULL, ...)

Arguments

x	a predx prediction object or a caretx model.
...	arguments passed to methods, currently none.
newdata	optional, a data frame with the test data.

Details

For regression, NULL is returned with a warning. The function uses internally multiClassSummary. clstats is a S3 generic function.

Value

For predx objects: a data frame with class-specific receiver-operator characteristic as well as class-specific Brier scores and average class assignment probabilities. For caretx a list of such data frames, each one for the train, resample and, it newdata is specified, the training data set.

References

Kuhn M. Building predictive models in R using the caret package. J Stat Softw (2008) 28:1–26. doi:10.18637/jss.v028.i05

Brier GW. VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY. Mon Weather Rev (1950) 78:1–3. doi:10.1175/1520-0493(1950)078<0001:vofeit>2.0.co;2

Goldstein-Greenwood J. A Brief on Brier Scores | UVA Library. (2021) Available at: https://library.virginia.edu/data/articles/a-brief-on-brier-scores

Cohen J. A Coefficient of Agreement for Nominal Scales. Educ Psychol Meas (1960) 20:37–46. doi:10.1177/001316446002000104

PiotrTymoszuk/caretExtra documentation built on Oct. 15, 2023, 10:03 p.m.