friedman_test: Friedman's test

In RebeccaGroh/seqbtests: Sequential Bayesian Comparison of ML Algorithm Performances

Description

This function implements the Friedman's test for multiple comparisons. A non-parametric statistical test to detect differences in in algorithms performances over multiple datasets.

Usage

friedman_test(df, measure = NULL)

Arguments

df	('list') Data frame containing the performane measure.
measure	('character') Name of the 'measure' column. If not defined, the first 'measure' column in the data frame is used.

Details

The test has first been implemented in scmamp.

Value

A list containing the following components:

• measure ('character')
  A string with the name of the measure column.

• method ('character')
  A string with the name of the method.

• statistic ('double')
  The value of the statistic used in the test.

• p_value ('double')
  The p-value for the test.

References

https://github.com/b0rxa/scmamp

Examples

    results <- friedman_test(test_benchmark) 

RebeccaGroh/seqbtests documentation built on Nov. 17, 2021, 8:50 a.m.