scmamp: Statistical Comparison of Multiple Algorithms in Multiple Problems

Given a matrix with results of different algorithms for different problems, the package uses statistical tests and corrections to assess the differences between algorithms.

Install the latest version of this package by entering the following in R:
install.packages("scmamp")
AuthorBorja Calvo [aut, cre], Guzman Santafe [aut]
Date of publication2016-10-21 12:28:46
MaintainerBorja Calvo <borja.calvo@ehu.eus>
LicenseGPL-2
Version0.2.55

View on CRAN

Man pages

adjustBergmannHommel: Bergmann and Hommel dynamic correction of p-values.

adjustFinner: Finner correction of p-values

adjustHolland: Holland correction of p-values.

adjustLi: Li correction of p-values.

adjustRom: Rom correction of p-values

adjustShaffer: Shaffer's correction of p-values in pairwise comparisons. .

anovaTest: ANOVA test for multiple comparisons

booleanMatrix: Creation of boolean matrices for highlighting results

contrastEstimationMatrix: Contrast estimation based on medians

customPost: Function to use custom tests to perform post hoc comparisons.

data.blum.2015: Comparison of optimization algorithms in Blum _et al._ (2015)

data.gh.2008: Example in Garcia and Herrera (2008)

data.gh.2010: Example in Garcia and Herrera (2010)

drawAlgorithmGraph: Hypotheses represented as a graph

exhaustiveSets: Complete set of exhaustive sets.

filterData: Expression based row filtering

friedmanAlignedRanksPost: Friedman's Aligned Ranks post hoc raw p-values

friedmanAlignedRanksTest: Friedman's Aligned Ranks test

friedmanPost: Friedman's post hoc raw p-values

friedmanTest: Friedman's test

imanDavenportTest: Iman Davenport's modification of Friedman's test

multipleComparisonTest: Tests for multiple comparisons

nemenyiTest: Nemenyi test

plotCD: Critical difference plot

plotDensities: Kernel based density estimation of the samples

plotPvalues: Plotting the p-value matrix

plotRanking: Ranking Plots

postHocTest: Post hoc tests for multiple comparison analises

qqplotGaussian: Gaussian distribution quantile-quantile plot

quadePost: Quade post hoc raw p-values

quadeTest: Quade's test

rankMatrix: Get the ranking matrix.

readComparisonDir: Read data from a directory of comparison-like files

readComparisonFile: Read data from a comparison file

readExperimentDir: Read data from an experiment-like files in a directory

readExperimentFile: Read data from an experiment-like file

scmamp: Statistical comparison of multiple algorithms

summarizeData: Summarization of data

tukeyPost: Tukey post hoc test for ANOVA.

tukeyTest: Tukey test

wilcoxonSignedTest: Wilcoxon signed-rank est

writeTabular: Write a table in LaTeX format

Functions

adjustBergmannHommel Man page
adjustFinner Man page
adjustHolland Man page
adjustLi Man page
adjustRom Man page
adjustShaffer Man page
anovaTest Man page
booleanMatrix Man page
contrastEstimationMatrix Man page
customPost Man page
data.blum.2015 Man page
data.gh.2008 Man page
data.gh.2010 Man page
drawAlgorithmGraph Man page
exhaustiveSets Man page
filterData Man page
friedmanAlignedRanksPost Man page
friedmanAlignedRanksTest Man page
friedmanPost Man page
friedmanTest Man page
imanDavenportTest Man page
multipleComparisonTest Man page
nemenyiTest Man page
plotCD Man page
plotDensities Man page
plotPvalues Man page
plotRanking Man page
postHocTest Man page
qqplotGaussian Man page
quadePost Man page
quadeTest Man page
rankMatrix Man page
readComparisonDir Man page
readComparisonFile Man page
readExperimentDir Man page
readExperimentFile Man page
scmamp Man page
scmamp-package Man page
summarizeData Man page
tukeyPost Man page
tukeyTest Man page
wilcoxonSignedTest Man page
writeTabular Man page

Files

inst
inst/CITATION
inst/loading_tests
inst/loading_tests/comparison_files
inst/loading_tests/comparison_files/rgg_size_1000_r_0.094.out
inst/loading_tests/comparison_files/rgg_size_5000_r_0.036.out
inst/loading_tests/comparison_files/rgg_size_100_r_0.143.out
inst/loading_tests/comparison_files/rgg_size_100_r_0.146.out
inst/loading_tests/comparison_files/rgg_size_100_r_0.161.out
inst/loading_tests/comparison_files/rgg_size_5000_r_0.048.out
inst/loading_tests/comparison_files/rgg_size_5000_r_0.096.out
inst/loading_tests/comparison_files/rgg_size_1000_r_0.058.out
inst/loading_tests/comparison_files/rgg_size_1000_r_0.134.out
inst/loading_tests/comparison_files/rgg_size_1000_r_0.049.out
inst/loading_tests/comparison_files/rgg_size_1000_r_0.103.out
inst/loading_tests/comparison_files/rgg_size_5000_r_0.060.out
inst/loading_tests/comparison_files/rgg_size_100_r_0.164.out
inst/loading_tests/comparison_files/rgg_size_5000_r_0.084.out
inst/loading_tests/comparison_files/rgg_size_1000_r_0.067.out
inst/loading_tests/comparison_files/rgg_size_100_r_0.140.out
inst/loading_tests/comparison_files/rgg_size_1000_r_0.112.out
inst/loading_tests/comparison_files/rgg_size_5000_r_0.072.out
inst/loading_tests/comparison_files/rgg_size_100_r_0.169.out
inst/loading_tests/comparison_files/rgg_size_5000_r_0.024.out
inst/loading_tests/comparison_files/rgg_size_1000_r_0.076.out
inst/loading_tests/comparison_files/rgg_size_5000_r_0.120.out
inst/loading_tests/comparison_files/rgg_size_1000_r_0.085.out
inst/loading_tests/comparison_files/rgg_size_100_r_0.152.out
inst/loading_tests/comparison_files/rgg_size_5000_r_0.108.out
inst/loading_tests/comparison_files/rgg_size_100_r_0.155.out
inst/loading_tests/comparison_files/rgg_size_100_r_0.149.out
inst/loading_tests/comparison_files/rgg_size_5000_r_0.134.out
inst/loading_tests/comparison_files/rgg_size_100_r_0.158.out
inst/loading_tests/comparison_files/rgg_size_1000_r_0.121.out
inst/loading_tests/rgg_complete_experiment.out
inst/loading_tests/experiment_files
inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Turau.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Rand2.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Rand1.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Turau.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Turau.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Shukla.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Shukla.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Rand1.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.164_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Rand2.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Shukla.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Shukla.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Rand1.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Rand2.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.146_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Shukla.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Turau.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Rand2.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Rand1.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Shukla.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Shukla.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Shukla.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Rand2.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Rand2.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Turau.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Turau.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Rand1.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Turau.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Rand1.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Rand1.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Rand1.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.158_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.152_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Rand2.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Rand1.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Turau.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.149_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Rand1.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Shukla.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Rand1.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Rand2.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Shukla.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Shukla.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Shukla.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Rand2.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Turau.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Rand2.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.169_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.155_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.143_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.169_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Shukla.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Rand2.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Rand2.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Rand1.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.140_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.169_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.155_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Turau.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Rand1.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Rand2.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Rand1.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Rand1.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Rand2.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Turau.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Turau.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Turau.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.164_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Rand2.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Turau.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Rand2.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.149_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.158_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Rand2.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.161_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Rand2.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.155_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.146_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Shukla.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.140_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Shukla.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Turau.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Turau.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Rand2.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Rand1.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Turau.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Rand1.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Turau.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Turau.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Shukla.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Rand1.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.143_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.143_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Turau.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Shukla.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Turau.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Turau.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Turau.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Rand1.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Turau.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Shukla.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.140_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.161_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.146_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Rand2.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Rand1.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Shukla.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.158_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Rand1.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Turau.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.149_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Turau.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.164_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Turau.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Shukla.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Rand2.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Rand1.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Shukla.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Rand1.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Rand1.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Rand1.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Shukla.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Rand1.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Shukla.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Shukla.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Rand2.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Rand2.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Shukla.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Rand2.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Rand2.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Rand2.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Rand2.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Shukla.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Rand1.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Rand1.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Rand1.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Shukla.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.152_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Rand2.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Turau.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.161_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_FruitFly.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Rand1.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Shukla.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Rand2.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Turau.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.152_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_FrogCOL.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Turau.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Ikeda.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Shukla.out
inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Shukla.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_FrogMIS.out
inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Rand2.out
inst/loading_tests/rgg_complete_comparison.out
inst/doc
inst/doc/Statistical_assessment_of_the_differences.html
inst/doc/Data_loading_and_manipulation.Rmd
inst/doc/Data_loading_and_manipulation.R inst/doc/Statistical_assessment_of_the_differences.R
inst/doc/Data_loading_and_manipulation.html
inst/doc/Statistical_assessment_of_the_differences.Rmd
NAMESPACE
data
data/data_gh_2008.RData
data/data_blum_2015.RData
data/datalist
data/data_gh_2010.RData
R
R/plotting.R
R/sysdata.rda
R/post_hoc.R R/latex.R R/data_manipulation.R R/scmamp.R R/loading_functions.R R/tests.R
vignettes
vignettes/refs.bib
vignettes/Data_loading_and_manipulation.Rmd
vignettes/Statistical_assessment_of_the_differences.Rmd
README.md
MD5
build
build/vignette.rds
DESCRIPTION
man
man/readComparisonDir.Rd man/friedmanAlignedRanksPost.Rd man/scmamp.Rd man/adjustHolland.Rd man/friedmanAlignedRanksTest.Rd man/anovaTest.Rd man/adjustShaffer.Rd man/rankMatrix.Rd man/imanDavenportTest.Rd man/readExperimentFile.Rd man/adjustBergmannHommel.Rd man/tukeyPost.Rd man/quadeTest.Rd man/data.blum.2015.Rd man/quadePost.Rd man/customPost.Rd man/friedmanPost.Rd man/qqplotGaussian.Rd man/postHocTest.Rd man/contrastEstimationMatrix.Rd man/data.gh.2010.Rd man/writeTabular.Rd man/nemenyiTest.Rd man/multipleComparisonTest.Rd man/plotDensities.Rd man/drawAlgorithmGraph.Rd man/plotRanking.Rd man/plotPvalues.Rd man/wilcoxonSignedTest.Rd man/exhaustiveSets.Rd man/adjustFinner.Rd man/filterData.Rd man/readComparisonFile.Rd man/friedmanTest.Rd man/summarizeData.Rd man/readExperimentDir.Rd man/plotCD.Rd man/tukeyTest.Rd man/booleanMatrix.Rd man/data.gh.2008.Rd man/adjustRom.Rd man/adjustLi.Rd

Questions? Problems? Suggestions? or email at ian@mutexlabs.com.

Please suggest features or report bugs with the GitHub issue tracker.

All documentation is copyright its authors; we didn't write any of that.