infer: Hypothesis testing regarding model performances

In maxwestphal/SEPM: Statistical Evaluation of Prediction Models

Hypothesis testing regarding model performances

Description

This functions allows hypothesis testing regarding a hypothesis system based on some previously derived parameter estimates (see estimate).

Usage

infer(estimation, method = "maxT", transform = "none")

Arguments

estimation	object of class SEPM.estimation (see estimate).
method	character; specify the (multiple) test used (default: "maxT", currently the only choice)
transform	character; specify a known transform, e.g. "none" (default), "logit" or "asin.sqrt". Alternativly a object of class SEPM.transform created via define_transform).

Value

An SEPM.inference object, including inference results, parameters estimates and hypothesis.

Examples

set.seed(1337)
y <- rep(1:0, times=c(3,7))
yhat <- cbind(model1 = rep(1:0, 5),
             model2 = rep(0, 10),
             model3 = rep(1:0, times=c(2,8)))
define_hypothesis("accuracy", threshold = 0.75) %>%
 compare(predictions = yhat, labels = y) %>%
 estimate() %>%
 infer() %>%
 summary()

maxwestphal/SEPM documentation built on April 12, 2024, 12:09 a.m.