wilcoxon_signed_test: Wilcoxon signed-rank test

In RebeccaGroh/seqbtests: Sequential Bayesian Comparison of ML Algorithm Performances

Description

This function implements the paired Wilcoxon signed-rank test. A non-parametric statistical hypothesis test to compare the means of two paired samples.

Usage

wilcoxon_signed_test(df, problem, baseline, algorithm = NULL, measure = NULL)

Arguments

df	('list') Data frame containing the performane measure.
problem	('character') Problem set used to evaluate the algorithms performance. Value in 'problem' column.
baseline	('character') First algorithm. Value in 'algorithm' column.
algorithm	('character') Second algorithm. Value in 'algorithm' column. If not defined, the baseline is tested against all algorithms in the data frame.
measure	('character') Name of the 'measure' column. If not defined, the first 'measure' column in the data frame is used.

Details

The test has first been implemented in scmamp.

Value

A list containing the following components:

• measure ('character')
  A string with the name of the measure column.

• method ('character')
  A string with the name of the method.

• statistic ('double')
  The value of the statistic used in the test.

• p_value ('double')
  The p-value for the test.

References

https://github.com/b0rxa/scmamp

Examples

    results <- wilcoxon_signed_test(df = test_benchmark, baseline = "algo_1",
    algorithm = "algo_2", problem = "problem_a")  

RebeccaGroh/seqbtests documentation built on Nov. 17, 2021, 8:50 a.m.