testPaired: Paired Wilcoxon statistical test

In exreport: Fast, Reliable and Elegant Reproducible Research

Description

This function performs a Wilcoxon paired test to compare the methods of an experiment consisting exactly on two of them. If more methods are present, then a multiple comparison test must be applied.

Usage

testPaired(e, output, rankOrder = "max", alpha = 0.05)

Arguments

e	Input experiment
output	The output for which the tet will be performed.
rankOrder	The optimization strategy, can be either maximizing "max" or minimizing "min" the target output variable.
alpha	The significance level used for the whole testing procedure.

Value

a testPaired object

Examples

# First we create an experiment from the wekaExperiment problem and prepare
# it to apply the test, we must subset it to only two methods:
experiment <- expCreate(wekaExperiment, name="test", parameter="fold")
experiment <- expSubset(experiment, list(method = c("J48", "NaiveBayes")))
experiment <- expSubset(experiment, list(featureSelection = c("no")))
experiment <- expReduce(experiment, "fold", mean)
experiment <- expInstantiate(experiment, removeUnary=TRUE)

# Then we perform a Wilcoxon test procedure
test <- testPaired(experiment, "accuracy", "max")

summary(test)

exreport documentation built on May 1, 2019, 10:13 p.m.