summary.sperroresterror calculates mean, standard deviation,
median etc. of the calculated error measures at the specified level
(overall, repetition, or fold).
summary.sperrorestreperror does the same with the pooled error,
at the overall or repetition level.
1 2 3
Level at which errors are summarized: 0: overall; 1: repetition; 2: fold
additional arguments (currently ignored)
Let's use an example to explain the
E.g., assume we are using 100-repeated 10-fold cross-validation.
error.rep = TRUE (default), the mean and standard deviation calculated
when summarizing at
level = 0
are calculated across the error estimates obtained for
each of the
100*10 = 1000 folds.
error.rep = FALSE, mean and standard deviation are calculated across
100 repetitions, using the weighted average of the fold-level
errors to calculate an error value for the entire sample.
This will essentially not affect the mean value but of course the
standard deviation of the error.
error.rep = FALSE is not recommended,
it is mainly for testing purposes; when the test sets are small
(as in leave-one-out cross-validation, in the extreme case),
error.rep = TRUE and
examine only the
error.rep component of its result.
Depending on the level of aggregation, a
data.frame with mean, and at level 0 also standard deviation,
median and IQR of the error measures.