benchmark: Benchmark Experiments Toolbox

Share:

The benchmark package provides a toolbox for setup, execution and analysis of benchmark experiments. Main focus is the analysis of data accumulating during the execution -- one primary objective is the statistical correct computation of the candidate algorithms' order.

Author
Manuel J. A. Eugster [aut, cre]
Date of publication
2014-05-02 21:48:47
Maintainer
Manuel J. A. Eugster <manuel@mjae.net>
License
GPL (>= 2)
Version
0.3-6
URLs

View on CRAN

Man pages

algperf-paircomp
Pairwise comparison of algorithm performances
algperf-visualization
Common visualizations of algorithm performances
as.dataset
Dataset abstraction
as.psychobench
Coerce benchmark experiment warehouse to preference table
as.relation.PaircompDecision
Relations based on pairwise comparisons
as.warehouse
Coerce objects to benchmark experiment warehouse
benchmark
Benchmark experiment setup and execution
benchmark-comptime
Performance measures
benchmark-sampling
Sampling functions
beplot0
Benchmark experiment plot
bsgraph0
Benchmark experiment graph
bsplot0
Benchmark experiment summary plot.
characterize
Dataset characterization framework
datachar-visualization
Visualization of dataset characteristics
ghraw
Grasshopper domain benchmark experiment results
monks3raw
monks3 benchmark experiment results
StatlogCharacteristics
StatLog dataset characteristics
subset.AlgorithmPerformance
Return subsets of 'AlgorithmPerformance' objects
TestProcedure
Test procedures infrastructure
testres-visualization
Visualization methods for (sequential) test results.
uci621raw
uci621 benchmark experiment results
warehouse
Benchmark experiment warehouse

Files in this package

benchmark
benchmark/TODO
benchmark/inst
benchmark/inst/CITATION
benchmark/inst/doc
benchmark/inst/doc/index.html
benchmark/inst/doc/Package-Concept.dia
benchmark/inst/doc/Package-Concept.pdf
benchmark/NAMESPACE
benchmark/demo
benchmark/demo/lsbenchplot-gh.R
benchmark/demo/benchplot.R
benchmark/demo/00Index
benchmark/demo/lsbenchplot-cs621-atypes.R
benchmark/demo/lsbenchplot-cs621.R
benchmark/NEWS
benchmark/data
benchmark/data/ghrel.RData
benchmark/data/uci621rel.RData
benchmark/data/monks3raw.RData
benchmark/data/ghraw.RData
benchmark/data/uci621raw.RData
benchmark/R
benchmark/R/algperf-paircomp.R
benchmark/R/dataset-characterization.R
benchmark/R/as.warehouse.R
benchmark/R/dataset-characteristics.R
benchmark/R/algperf.R
benchmark/R/algperf-preference.R
benchmark/R/bsgraph.R
benchmark/R/warehouse.R
benchmark/R/bsplot.R
benchmark/R/as.psychobench.R
benchmark/R/benchmark.R
benchmark/R/datachar-visualizations.R
benchmark/R/testprocedure.R
benchmark/R/algperf-beplot0.R
benchmark/R/dataset.R
benchmark/R/proto.R
benchmark/R/algperf-visualizations.R
benchmark/R/testres-analysis.R
benchmark/R/testres-visualizations.R
benchmark/MD5
benchmark/DESCRIPTION
benchmark/man
benchmark/man/as.relation.PaircompDecision.Rd
benchmark/man/subset.AlgorithmPerformance.Rd
benchmark/man/datachar-visualization.Rd
benchmark/man/benchmark.Rd
benchmark/man/bsgraph0.Rd
benchmark/man/as.dataset.Rd
benchmark/man/as.warehouse.Rd
benchmark/man/benchmark-sampling.Rd
benchmark/man/bsplot0.Rd
benchmark/man/testres-visualization.Rd
benchmark/man/TestProcedure.Rd
benchmark/man/StatlogCharacteristics.Rd
benchmark/man/algperf-paircomp.Rd
benchmark/man/warehouse.Rd
benchmark/man/as.psychobench.Rd
benchmark/man/monks3raw.Rd
benchmark/man/beplot0.Rd
benchmark/man/uci621raw.Rd
benchmark/man/ghraw.Rd
benchmark/man/characterize.Rd
benchmark/man/benchmark-comptime.Rd
benchmark/man/algperf-visualization.Rd