nemenyiTest: Nemenyi test

In scmamp: Statistical Comparison of Multiple Algorithms in Multiple Problems

Description

This function performs the Nemenyi test

Usage

nemenyiTest(data, alpha = 0.05)

Arguments

data	Matrix or data frame where each algorithm is in a column
alpha	Significance level

Details

The test has been implemented according to the version in Demsar (2006), page 7

Value

A list with class "htest" containing the following components: statistic, the value of the statistic used in the test; method, a character string indicating what type of test was performed; data.name, a character string giving the name of the data and diff.matirx, a matrix with all the pairwise differences of average rankings

References

Demsar, J. (2006) Statistical Comparisons of Classifiers over Multiple Data Sets. Journal of Machine Learning Research, 7, 1-30.

Examples

data(data_gh_2008)
res <- nemenyiTest(data.gh.2008, alpha = 0.1)
res
res$diff.matrix

Example output

	Nemenyi test

data:  data.gh.2008
Critical difference = 1.014, k = 5, df = 145

          C4.5  k-NN(k=1) NaiveBayes    Kernel        CN2
[1,]  0.000000 -1.1500000 -0.1000000 -2.233333 -1.0166667
[2,] -1.150000  0.0000000  1.0500000 -1.083333  0.1333333
[3,] -0.100000  1.0500000  0.0000000 -2.133333 -0.9166667
[4,] -2.233333 -1.0833333 -2.1333333  0.000000  1.2166667
[5,] -1.016667  0.1333333 -0.9166667  1.216667  0.0000000

scmamp documentation built on May 1, 2019, 10:10 p.m.