testThenRank: Performs ranking via test-then-rank

View source: R/rankingMethods.R

testThenRankR Documentation

Performs ranking via test-then-rank

Description

Computes statistical hypothesis tests based on Wilcoxon signed rank test for each possible pair of algorithms to assess differences in metric values between the algorithms. Then ranking is performed according to the number of significant one-sided test results. If algorithms have the same number of significant test results, then they obtain the same rank.

Usage

testThenRank(object, ties.method = "min", ...)

Arguments

object

The challenge object.

ties.method

A string specifying how ties are treated, see base::rank().

...

Further arguments passed to or from other functions.

Value

An S3 object of class "ranked.list" to represent a ranked assessment data set.

See Also

Other ranking functions: aggregateThenRank(), rankThenAggregate()

Examples

## Not run: 
 testThenRank(challenge,
              alpha=0.05, # significance level
              p.adjust.method="none", # method for adjustment for multiple testing, see ?p.adjust
              na.treat = 0)

## End(Not run)


wiesenfa/challengeR documentation built on Aug. 25, 2023, 6:43 a.m.