scmamp: Statistical Comparison of Multiple Algorithms in Multiple Problems

Given a matrix with results of different algorithms for different problems, the package uses statistical tests and corrections to assess the differences between algorithms.

AuthorBorja Calvo [aut, cre], Guzman Santafe [aut]
Date of publication2016-10-21 12:28:46
MaintainerBorja Calvo <borja.calvo@ehu.eus>
LicenseGPL-2
Version0.2.55

View on CRAN

Man pages

adjustBergmannHommel: Bergmann and Hommel dynamic correction of p-values.

adjustFinner: Finner correction of p-values

adjustHolland: Holland correction of p-values.

adjustLi: Li correction of p-values.

adjustRom: Rom correction of p-values

adjustShaffer: Shaffer's correction of p-values in pairwise comparisons. .

anovaTest: ANOVA test for multiple comparisons

booleanMatrix: Creation of boolean matrices for highlighting results

contrastEstimationMatrix: Contrast estimation based on medians

customPost: Function to use custom tests to perform post hoc comparisons.

data.blum.2015: Comparison of optimization algorithms in Blum _et al._ (2015)

data.gh.2008: Example in Garcia and Herrera (2008)

data.gh.2010: Example in Garcia and Herrera (2010)

drawAlgorithmGraph: Hypotheses represented as a graph

exhaustiveSets: Complete set of exhaustive sets.

filterData: Expression based row filtering

friedmanAlignedRanksPost: Friedman's Aligned Ranks post hoc raw p-values

friedmanAlignedRanksTest: Friedman's Aligned Ranks test

friedmanPost: Friedman's post hoc raw p-values

friedmanTest: Friedman's test

imanDavenportTest: Iman Davenport's modification of Friedman's test

multipleComparisonTest: Tests for multiple comparisons

nemenyiTest: Nemenyi test

plotCD: Critical difference plot

plotDensities: Kernel based density estimation of the samples

plotPvalues: Plotting the p-value matrix

plotRanking: Ranking Plots

postHocTest: Post hoc tests for multiple comparison analises

qqplotGaussian: Gaussian distribution quantile-quantile plot

quadePost: Quade post hoc raw p-values

quadeTest: Quade's test

rankMatrix: Get the ranking matrix.

readComparisonDir: Read data from a directory of comparison-like files

readComparisonFile: Read data from a comparison file

readExperimentDir: Read data from an experiment-like files in a directory

readExperimentFile: Read data from an experiment-like file

scmamp: Statistical comparison of multiple algorithms

summarizeData: Summarization of data

tukeyPost: Tukey post hoc test for ANOVA.

tukeyTest: Tukey test

wilcoxonSignedTest: Wilcoxon signed-rank est

writeTabular: Write a table in LaTeX format

Functions

adjustBergmannHommel Man page
adjustFinner Man page
adjustHolland Man page
adjustLi Man page
adjustRom Man page
adjustShaffer Man page
anovaTest Man page
booleanMatrix Man page
contrastEstimationMatrix Man page
customPost Man page
data.blum.2015 Man page
data.gh.2008 Man page
data.gh.2010 Man page
drawAlgorithmGraph Man page
exhaustiveSets Man page
filterData Man page
friedmanAlignedRanksPost Man page
friedmanAlignedRanksTest Man page
friedmanPost Man page
friedmanTest Man page
imanDavenportTest Man page
multipleComparisonTest Man page
nemenyiTest Man page
plotCD Man page
plotDensities Man page
plotPvalues Man page
plotRanking Man page
postHocTest Man page
qqplotGaussian Man page
quadePost Man page
quadeTest Man page
rankMatrix Man page
readComparisonDir Man page
readComparisonFile Man page
readExperimentDir Man page
readExperimentFile Man page
scmamp Man page
scmamp-package Man page
summarizeData Man page
tukeyPost Man page
tukeyTest Man page
wilcoxonSignedTest Man page
writeTabular Man page

Files

scmamp
scmamp/inst
scmamp/inst/CITATION
scmamp/inst/loading_tests
scmamp/inst/loading_tests/comparison_files
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.094.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.036.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.143.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.146.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.161.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.048.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.096.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.058.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.134.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.049.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.103.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.060.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.164.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.084.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.067.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.140.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.112.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.072.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.169.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.024.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.076.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.120.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.085.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.152.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.108.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.155.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.149.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.134.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.158.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.121.out
scmamp/inst/loading_tests/rgg_complete_experiment.out
scmamp/inst/loading_tests/experiment_files
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Rand2.out
scmamp/inst/loading_tests/rgg_complete_comparison.out
scmamp/inst/doc
scmamp/inst/doc/Statistical_assessment_of_the_differences.html
scmamp/inst/doc/Data_loading_and_manipulation.Rmd
scmamp/inst/doc/Data_loading_and_manipulation.R
scmamp/inst/doc/Statistical_assessment_of_the_differences.R
scmamp/inst/doc/Data_loading_and_manipulation.html
scmamp/inst/doc/Statistical_assessment_of_the_differences.Rmd
scmamp/NAMESPACE
scmamp/data
scmamp/data/data_gh_2008.RData
scmamp/data/data_blum_2015.RData
scmamp/data/datalist
scmamp/data/data_gh_2010.RData
scmamp/R
scmamp/R/plotting.R
scmamp/R/sysdata.rda
scmamp/R/post_hoc.R scmamp/R/latex.R scmamp/R/data_manipulation.R scmamp/R/scmamp.R scmamp/R/loading_functions.R scmamp/R/tests.R
scmamp/vignettes
scmamp/vignettes/refs.bib
scmamp/vignettes/Data_loading_and_manipulation.Rmd
scmamp/vignettes/Statistical_assessment_of_the_differences.Rmd
scmamp/README.md
scmamp/MD5
scmamp/build
scmamp/build/vignette.rds
scmamp/DESCRIPTION
scmamp/man
scmamp/man/readComparisonDir.Rd scmamp/man/friedmanAlignedRanksPost.Rd scmamp/man/scmamp.Rd scmamp/man/adjustHolland.Rd scmamp/man/friedmanAlignedRanksTest.Rd scmamp/man/anovaTest.Rd scmamp/man/adjustShaffer.Rd scmamp/man/rankMatrix.Rd scmamp/man/imanDavenportTest.Rd scmamp/man/readExperimentFile.Rd scmamp/man/adjustBergmannHommel.Rd scmamp/man/tukeyPost.Rd scmamp/man/quadeTest.Rd scmamp/man/data.blum.2015.Rd scmamp/man/quadePost.Rd scmamp/man/customPost.Rd scmamp/man/friedmanPost.Rd scmamp/man/qqplotGaussian.Rd scmamp/man/postHocTest.Rd scmamp/man/contrastEstimationMatrix.Rd scmamp/man/data.gh.2010.Rd scmamp/man/writeTabular.Rd scmamp/man/nemenyiTest.Rd scmamp/man/multipleComparisonTest.Rd scmamp/man/plotDensities.Rd scmamp/man/drawAlgorithmGraph.Rd scmamp/man/plotRanking.Rd scmamp/man/plotPvalues.Rd scmamp/man/wilcoxonSignedTest.Rd scmamp/man/exhaustiveSets.Rd scmamp/man/adjustFinner.Rd scmamp/man/filterData.Rd scmamp/man/readComparisonFile.Rd scmamp/man/friedmanTest.Rd scmamp/man/summarizeData.Rd scmamp/man/readExperimentDir.Rd scmamp/man/plotCD.Rd scmamp/man/tukeyTest.Rd scmamp/man/booleanMatrix.Rd scmamp/man/data.gh.2008.Rd scmamp/man/adjustRom.Rd scmamp/man/adjustLi.Rd

Questions? Problems? Suggestions? or email at ian@mutexlabs.com.

Please suggest features or report bugs with the GitHub issue tracker.

All documentation is copyright its authors; we didn't write any of that.