nemenyi_test: Nemenyi post hoc test

In RebeccaGroh/seqbtests: Sequential Bayesian Comparison of ML Algorithm Performances

Description

This function implements the Nemenyi post hoc test.

Usage

nemenyi_test(df, measure = NULL, alpha = 0.05)

Arguments

df	('list') Data frame containing the performane measure.
measure	('character') Name of the 'measure' column. If not defined, the first 'measure' column in the data frame is used.
alpha	('double') Significance level to get the critical difference.

Details

The test has first been implemented in scmamp.

Value

A list containing the following components:

• measure ('character')
  A string with the name of the measure column.

• method ('character')
  A string with the name of the method.

• statistic ('double')
  The value of the statistic used in the test.

• p_value ('double')
  The p-value for the test.

• diff_matrix ('matrix')
  A matrix with all the pair wise differences of average rankings.

References

https://github.com/b0rxa/scmamp

Examples

    nemenyi_test(test_benchmark)

RebeccaGroh/seqbtests documentation built on Nov. 17, 2021, 8:50 a.m.