benchmark: Benchmark experiment setup and execution

In benchmark: Benchmark Experiments Toolbox

Description

Function to execute benchmark experiments and to collect all data the package can analyze. For more sophisticated benchmark experiments we suggest the usage of the mlr package.

Usage

benchmark(datasets, sampling, algorithms = NULL, performances = NULL,
  characteristics = NULL, test = NULL, test.burnin = 3, verbose = TRUE)

Arguments

datasets	List of data.frames
sampling	Sampling function, see benchmark-sampling.
algorithms	List of algorithms; i.e., functions which take a model formula and a data.frame to fit a model. Note that a predict function must be defined as well.
performances	List of performance measure functions; i.e., functions with arguments yhat and y. See, e.g., benchmark-comptime.
characteristics	DatasetCharacteristics object; e.g., StatlogCharacteristics
test	TestProcedure object
test.burnin	Number of burn-in replications
verbose	Show information during execution

Value

A warehouse object

See Also

warehouse, as.warehouse, benchmark-sampling, benchmark-comptime

benchmark documentation built on May 30, 2017, 5:20 a.m.