scmamp: Statistical Comparison of Multiple Algorithms in Multiple Problems

Given a matrix with results of different algorithms for different problems, the package uses statistical tests and corrections to assess the differences between algorithms.

AuthorBorja Calvo [aut, cre], Guzman Santafe [aut]
Date of publication2016-10-21 12:28:46
MaintainerBorja Calvo <borja.calvo@ehu.eus>
LicenseGPL-2
Version0.2.55

View on CRAN

Man pages

adjustBergmannHommel: Bergmann and Hommel dynamic correction of p-values.

adjustFinner: Finner correction of p-values

adjustHolland: Holland correction of p-values.

adjustLi: Li correction of p-values.

adjustRom: Rom correction of p-values

adjustShaffer: Shaffer's correction of p-values in pairwise comparisons. .

anovaTest: ANOVA test for multiple comparisons

booleanMatrix: Creation of boolean matrices for highlighting results

contrastEstimationMatrix: Contrast estimation based on medians

customPost: Function to use custom tests to perform post hoc comparisons.

data.blum.2015: Comparison of optimization algorithms in Blum _et al._ (2015)

data.gh.2008: Example in Garcia and Herrera (2008)

data.gh.2010: Example in Garcia and Herrera (2010)

drawAlgorithmGraph: Hypotheses represented as a graph

exhaustiveSets: Complete set of exhaustive sets.

filterData: Expression based row filtering

friedmanAlignedRanksPost: Friedman's Aligned Ranks post hoc raw p-values

friedmanAlignedRanksTest: Friedman's Aligned Ranks test

friedmanPost: Friedman's post hoc raw p-values

friedmanTest: Friedman's test

imanDavenportTest: Iman Davenport's modification of Friedman's test

multipleComparisonTest: Tests for multiple comparisons

nemenyiTest: Nemenyi test

plotCD: Critical difference plot

plotDensities: Kernel based density estimation of the samples

plotPvalues: Plotting the p-value matrix

plotRanking: Ranking Plots

postHocTest: Post hoc tests for multiple comparison analises

qqplotGaussian: Gaussian distribution quantile-quantile plot

quadePost: Quade post hoc raw p-values

quadeTest: Quade's test

rankMatrix: Get the ranking matrix.

readComparisonDir: Read data from a directory of comparison-like files

readComparisonFile: Read data from a comparison file

readExperimentDir: Read data from an experiment-like files in a directory

readExperimentFile: Read data from an experiment-like file

scmamp: Statistical comparison of multiple algorithms

summarizeData: Summarization of data

tukeyPost: Tukey post hoc test for ANOVA.

tukeyTest: Tukey test

wilcoxonSignedTest: Wilcoxon signed-rank est

writeTabular: Write a table in LaTeX format

Files in this package

scmamp
scmamp/inst
scmamp/inst/CITATION
scmamp/inst/loading_tests
scmamp/inst/loading_tests/comparison_files
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.094.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.036.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.143.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.146.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.161.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.048.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.096.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.058.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.134.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.049.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.103.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.060.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.164.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.084.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.067.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.140.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.112.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.072.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.169.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.024.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.076.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.120.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.085.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.152.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.108.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.155.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.149.out
scmamp/inst/loading_tests/comparison_files/rgg_size_5000_r_0.134.out
scmamp/inst/loading_tests/comparison_files/rgg_size_100_r_0.158.out
scmamp/inst/loading_tests/comparison_files/rgg_size_1000_r_0.121.out
scmamp/inst/loading_tests/rgg_complete_experiment.out
scmamp/inst/loading_tests/experiment_files
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.067_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.169_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.024_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.072_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.134_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.048_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.085_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.158_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.146_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.149_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.096_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.143_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.161_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_FruitFly.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.121_Rand1.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.094_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.076_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.164_Rand2.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.134_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.084_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.103_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.152_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.120_FrogCOL.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.049_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.140_Turau.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.036_Ikeda.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.058_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_1000_r_0.112_Shukla.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.108_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_5000_r_0.060_FrogMIS.out
scmamp/inst/loading_tests/experiment_files/rgg_size_100_r_0.155_Rand2.out
scmamp/inst/loading_tests/rgg_complete_comparison.out
scmamp/inst/doc
scmamp/inst/doc/Statistical_assessment_of_the_differences.html
scmamp/inst/doc/Data_loading_and_manipulation.Rmd
scmamp/inst/doc/Data_loading_and_manipulation.R
scmamp/inst/doc/Statistical_assessment_of_the_differences.R
scmamp/inst/doc/Data_loading_and_manipulation.html
scmamp/inst/doc/Statistical_assessment_of_the_differences.Rmd
scmamp/NAMESPACE
scmamp/data
scmamp/data/data_gh_2008.RData
scmamp/data/data_blum_2015.RData
scmamp/data/datalist
scmamp/data/data_gh_2010.RData
scmamp/R
scmamp/R/plotting.R
scmamp/R/sysdata.rda
scmamp/R/post_hoc.R scmamp/R/latex.R scmamp/R/data_manipulation.R scmamp/R/scmamp.R scmamp/R/loading_functions.R scmamp/R/tests.R
scmamp/vignettes
scmamp/vignettes/refs.bib
scmamp/vignettes/Data_loading_and_manipulation.Rmd
scmamp/vignettes/Statistical_assessment_of_the_differences.Rmd
scmamp/README.md
scmamp/MD5
scmamp/build
scmamp/build/vignette.rds
scmamp/DESCRIPTION
scmamp/man
scmamp/man/readComparisonDir.Rd scmamp/man/friedmanAlignedRanksPost.Rd scmamp/man/scmamp.Rd scmamp/man/adjustHolland.Rd scmamp/man/friedmanAlignedRanksTest.Rd scmamp/man/anovaTest.Rd scmamp/man/adjustShaffer.Rd scmamp/man/rankMatrix.Rd scmamp/man/imanDavenportTest.Rd scmamp/man/readExperimentFile.Rd scmamp/man/adjustBergmannHommel.Rd scmamp/man/tukeyPost.Rd scmamp/man/quadeTest.Rd scmamp/man/data.blum.2015.Rd scmamp/man/quadePost.Rd scmamp/man/customPost.Rd scmamp/man/friedmanPost.Rd scmamp/man/qqplotGaussian.Rd scmamp/man/postHocTest.Rd scmamp/man/contrastEstimationMatrix.Rd scmamp/man/data.gh.2010.Rd scmamp/man/writeTabular.Rd scmamp/man/nemenyiTest.Rd scmamp/man/multipleComparisonTest.Rd scmamp/man/plotDensities.Rd scmamp/man/drawAlgorithmGraph.Rd scmamp/man/plotRanking.Rd scmamp/man/plotPvalues.Rd scmamp/man/wilcoxonSignedTest.Rd scmamp/man/exhaustiveSets.Rd scmamp/man/adjustFinner.Rd scmamp/man/filterData.Rd scmamp/man/readComparisonFile.Rd scmamp/man/friedmanTest.Rd scmamp/man/summarizeData.Rd scmamp/man/readExperimentDir.Rd scmamp/man/plotCD.Rd scmamp/man/tukeyTest.Rd scmamp/man/booleanMatrix.Rd scmamp/man/data.gh.2008.Rd scmamp/man/adjustRom.Rd scmamp/man/adjustLi.Rd

Questions? Problems? Suggestions? or email at ian@mutexlabs.com.

All documentation is copyright its authors; we didn't write any of that.