adjustShaffer: Shaffer's correction of p-values in pairwise comparisons. .

In scmamp: Statistical Comparison of Multiple Algorithms in Multiple Problems

Description

This function implements the Shaffer's (static) multiple testing correction when the p-values correspond with pairwise comparisons.

Usage

adjustShaffer(raw.matrix)

Arguments

raw.matrix

A matrix with the pairwise p-values. The p-values have to be, at least, in the upper part of the matrix.

Details

The test has been implemented according to the version in Garcia and Herrera (2008), page 2680.

Value

A symetric matrix with the corrected p-values.

References

S. Garcia and F. Herrera (2008) An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for All Pairwise Comparisons. Journal of Machine Learning Research, 9, 2677-2694.

J.P. Shaffer (1986) Modified sequentially rejective multiple test procedures. Journal of the American Statistical Association, 81(395), 826-831.

Examples

data(data_gh_2008)
raw.pvalues <- friedmanPost(data.gh.2008)
raw.pvalues
adjustShaffer(raw.pvalues)

Example output

                   C4.5   k-NN(k=1)   NaiveBayes       Kernel         CN2
C4.5                 NA 0.004848763 8.064959e-01 4.486991e-08 0.012763008
k-NN(k=1)  4.848763e-03          NA 1.011233e-02 7.963489e-03 0.743971478
NaiveBayes 8.064959e-01 0.010112334           NA 1.736118e-07 0.024744672
Kernel     4.486991e-08 0.007963489 1.736118e-07           NA 0.002880485
CN2        1.276301e-02 0.743971478 2.474467e-02 2.880485e-03          NA
                   C4.5  k-NN(k=1)   NaiveBayes       Kernel        CN2
C4.5                 NA 0.02909258 1.000000e+00 4.486991e-07 0.05105203
k-NN(k=1)  2.909258e-02         NA 4.778094e-02 4.778094e-02 1.00000000
NaiveBayes 1.000000e+00 0.04778094           NA 1.041671e-06 0.07423402
Kernel     4.486991e-07 0.04778094 1.041671e-06           NA 0.01728291
CN2        5.105203e-02 1.00000000 7.423402e-02 1.728291e-02         NA

scmamp documentation built on May 1, 2019, 10:10 p.m.