| evaluate | R Documentation |
Generic function to calculate evaluation measures for a data stream mining task DST on a data stream DSD object.
evaluate_static(object, dsd, measure, n, ...)
evaluate_stream(object, dsd, measure, n, horizon, ..., verbose = FALSE)
object |
The DST object that the evaluation measure is being requested from. |
dsd |
The DSD object used to create the test data. |
measure |
Evaluation measure(s) to use. If missing then all available measures are returned. See the Available measures note in the Details section for where to find the list of measures for each task. |
n |
The number of data points being requested. |
... |
Further arguments are passed on to the specific implementation (e.g., see evaluate.DSC) |
horizon |
Evaluation is done using horizon many previous points (see detail section). |
verbose |
Report progress? |
We define two generic evaluation functions:
evaluate_static() evaluates the current DST model on new data without updating the model.
evaluate_stream() evaluates the DST model using
prequential error estimation (see Gama, Sebastiao and Rodrigues; 2013). The data points
in the horizon are first used to calculate the evaluation measure and then
they are used for updating the cluster model. A horizon of ' means that each point is evaluated and
then used to update the model.
The available evaluation measures depend on the task. Currently available task to evaluate:
DSC via evaluate.DSC
Available measures: The measures that can be used for the argument
measure depend on the task and are listed in the help page of the
task's method. For DSC objects, see the Details section of
evaluate.DSC for internal and external measures
(e.g., "purity", "cRand", "SSQ"). If measure is missing, all measures
available for the task and stream (external measures need a stream that
provides class labels) are calculated.
evaluate returns an object of class stream_eval which
is a numeric vector of the values of the requested measures.
Michael Hahsler
Joao Gama, Raquel Sebastiao, Pedro Pereira Rodrigues (2013). On evaluating stream learning algorithms. Machine Learning, March 2013, Volume 90, Issue 3, pp 317-346.
Other DST:
DSAggregate(),
DSC(),
DSClassifier(),
DSOutlier(),
DSRegressor(),
DST(),
DST_SlidingWindow(),
DST_WriteStream(),
predict,
stream_pipeline,
update
Other evaluation:
animate_cluster(),
evaluate.DSC
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.