scmamp: Statistical Comparison of Multiple Algorithms in Multiple Problems

Share:

Given a matrix with results of different algorithms for different problems, the package uses statistical tests and corrections to assess the differences between algorithms.

Author
Borja Calvo [aut, cre], Guzman Santafe [aut]
Date of publication
2016-10-21 12:28:46
Maintainer
Borja Calvo <borja.calvo@ehu.eus>
License
GPL-2
Version
0.2.55

View on CRAN

Man pages

adjustBergmannHommel
Bergmann and Hommel dynamic correction of p-values.
adjustFinner
Finner correction of p-values
adjustHolland
Holland correction of p-values.
adjustLi
Li correction of p-values.
adjustRom
Rom correction of p-values
adjustShaffer
Shaffer's correction of p-values in pairwise comparisons. .
anovaTest
ANOVA test for multiple comparisons
booleanMatrix
Creation of boolean matrices for highlighting results
contrastEstimationMatrix
Contrast estimation based on medians
customPost
Function to use custom tests to perform post hoc comparisons.
data.blum.2015
Comparison of optimization algorithms in Blum _et al._ (2015)
data.gh.2008
Example in Garcia and Herrera (2008)
data.gh.2010
Example in Garcia and Herrera (2010)
drawAlgorithmGraph
Hypotheses represented as a graph
exhaustiveSets
Complete set of exhaustive sets.
filterData
Expression based row filtering
friedmanAlignedRanksPost
Friedman's Aligned Ranks post hoc raw p-values
friedmanAlignedRanksTest
Friedman's Aligned Ranks test
friedmanPost
Friedman's post hoc raw p-values
friedmanTest
Friedman's test
imanDavenportTest
Iman Davenport's modification of Friedman's test
multipleComparisonTest
Tests for multiple comparisons
nemenyiTest
Nemenyi test
plotCD
Critical difference plot
plotDensities
Kernel based density estimation of the samples
plotPvalues
Plotting the p-value matrix
plotRanking
Ranking Plots
postHocTest
Post hoc tests for multiple comparison analises
qqplotGaussian
Gaussian distribution quantile-quantile plot
quadePost
Quade post hoc raw p-values
quadeTest
Quade's test
rankMatrix
Get the ranking matrix.
readComparisonDir
Read data from a directory of comparison-like files
readComparisonFile
Read data from a comparison file
readExperimentDir
Read data from an experiment-like files in a directory
readExperimentFile
Read data from an experiment-like file
scmamp
Statistical comparison of multiple algorithms
summarizeData
Summarization of data
tukeyPost
Tukey post hoc test for ANOVA.
tukeyTest
Tukey test
wilcoxonSignedTest
Wilcoxon signed-rank est
writeTabular
Write a table in LaTeX format

Files in this package

scmamp
scmamp/inst
scmamp/inst/CITATION
scmamp/inst/loading_tests
scmamp/inst/loading_tests/comparison_files
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.094.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.036.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.143.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.146.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.161.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.048.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.096.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.058.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.134.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.049.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.103.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.060.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.164.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.084.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.067.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.140.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.112.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.072.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.169.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.024.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.076.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.120.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.085.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.152.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.108.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.155.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.149.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.134.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.158.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.121.out
scmamp/inst/loading_tests/rgg_complete_experiment.out
scmamp/inst/loading_tests/experiment_files
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Rand2.out
scmamp/inst/loading_tests/rgg_complete_comparison.out
scmamp/inst/doc
scmamp/inst/doc/Statistical_assessment_of_the_differences.html
scmamp/inst/doc/Data_loading_and_manipulation.Rmd
scmamp/inst/doc/Data_loading_and_manipulation.R
scmamp/inst/doc/Statistical_assessment_of_the_differences.R
scmamp/inst/doc/Data_loading_and_manipulation.html
scmamp/inst/doc/Statistical_assessment_of_the_differences.Rmd
scmamp/NAMESPACE
scmamp/data
scmamp/data/data_gh_2008.RData
scmamp/data/data_blum_2015.RData
scmamp/data/datalist
scmamp/data/data_gh_2010.RData
scmamp/R
scmamp/R/plotting.R
scmamp/R/sysdata.rda
scmamp/R/post_hoc.R
scmamp/R/latex.R
scmamp/R/data_manipulation.R
scmamp/R/scmamp.R
scmamp/R/loading_functions.R
scmamp/R/tests.R
scmamp/vignettes
scmamp/vignettes/refs.bib
scmamp/vignettes/Data_loading_and_manipulation.Rmd
scmamp/vignettes/Statistical_assessment_of_the_differences.Rmd
scmamp/README.md
scmamp/MD5
scmamp/build
scmamp/build/vignette.rds
scmamp/DESCRIPTION
scmamp/man
scmamp/man/readComparisonDir.Rd
scmamp/man/friedmanAlignedRanksPost.Rd
scmamp/man/scmamp.Rd
scmamp/man/adjustHolland.Rd
scmamp/man/friedmanAlignedRanksTest.Rd
scmamp/man/anovaTest.Rd
scmamp/man/adjustShaffer.Rd
scmamp/man/rankMatrix.Rd
scmamp/man/imanDavenportTest.Rd
scmamp/man/readExperimentFile.Rd
scmamp/man/adjustBergmannHommel.Rd
scmamp/man/tukeyPost.Rd
scmamp/man/quadeTest.Rd
scmamp/man/data.blum.2015.Rd
scmamp/man/quadePost.Rd
scmamp/man/customPost.Rd
scmamp/man/friedmanPost.Rd
scmamp/man/qqplotGaussian.Rd
scmamp/man/postHocTest.Rd
scmamp/man/contrastEstimationMatrix.Rd
scmamp/man/data.gh.2010.Rd
scmamp/man/writeTabular.Rd
scmamp/man/nemenyiTest.Rd
scmamp/man/multipleComparisonTest.Rd
scmamp/man/plotDensities.Rd
scmamp/man/drawAlgorithmGraph.Rd
scmamp/man/plotRanking.Rd
scmamp/man/plotPvalues.Rd
scmamp/man/wilcoxonSignedTest.Rd
scmamp/man/exhaustiveSets.Rd
scmamp/man/adjustFinner.Rd
scmamp/man/filterData.Rd
scmamp/man/readComparisonFile.Rd
scmamp/man/friedmanTest.Rd
scmamp/man/summarizeData.Rd
scmamp/man/readExperimentDir.Rd
scmamp/man/plotCD.Rd
scmamp/man/tukeyTest.Rd
scmamp/man/booleanMatrix.Rd
scmamp/man/data.gh.2008.Rd
scmamp/man/adjustRom.Rd
scmamp/man/adjustLi.Rd