This package implements the fast cross-validation via sequential testing (CVST) procedure. CVST is an improved cross-validation procedure which uses non-parametric testing coupled with sequential analysis to determine the best parameter set on linearly increasing subsets of the data. By eliminating underperforming candidates quickly and keeping promising candidates as long as possible, the method speeds up the computation while preserving the capability of a full cross-validation. Additionally to the CVST the package contains an implementation of the ordinary k-fold cross-validation with a flexible and powerful set of helper objects and methods to handle the overall model selection process. The implementations of the Cochran's Q test with permutations and the sequential testing framework of Wald are generic and can therefore also be used in other contexts.
|Author||Tammo Krueger, Mikio Braun|
|Date of publication||2013-12-10 14:50:04|
|Maintainer||Tammo Krueger <email@example.com>|
|License||GPL (>= 2.0)|
cochranq.test: Cochran's Q Test with Permutation
constructCVSTModel: Setup for a CVST Run.
constructData: Construction and Handling of 'CVST.data' Objects
constructLearner: Construction of Specific Learners for CVST
constructParams: Construct a Grid of Parameters
constructSequentialTest: Construct and Handle Sequential Tests.
CV: Perform a k-fold Cross-validation
CVST-package: Fast Cross-Validation via Sequential Testing
fastCV: The Fast Cross-Validation via Sequential Testing (CVST)...
noisyDonoho: Generate Donoho's Toy Data Sets
noisySine: Regression and Classification Toy Data Set