getScores: Obtaining the metric scores on the different iterations for a...

In performanceEstimation: An Infra-Structure for Performance Estimation of Predictive Models

Description

With this function we can obtain the different metric scores obtained by a given workflow on a given task, in the different iterations of a performance estimation experiment.

Usage

getScores(results, workflow, task)

Arguments

results	A ComparisonResults object
workflow	A string with the ID of a workflow
task	A string with the ID of a predictive task

Value

A matrix with as many rows as there are iterations and as many columns as there are metrics being estimated in the experiment

Author(s)

Luis Torgo [e-mail]

References

Torgo, L. (2014) An Infra-Structure for Performance Estimation and Experimental Comparison of Predictive Models in R. arXiv:1412.0436 [cs.MS] http://arxiv.org/abs/1412.0436

See Also

taskNames,workflowNames,metricNames,estimationSummary

Examples

## Not run: 
## Estimating MSE for 3 variants of both
## regression trees and SVMs, on  two data sets, using one repetition
## of 10-fold CV
library(e1071)
library(DMwR)
data(swiss)
data(mtcars)

## running the estimation experiment
res <- performanceEstimation(
  c(PredTask(Infant.Mortality ~ .,swiss),PredTask(mpg ~ ., mtcars)),
  c(workflowVariants(learner="svm",
                     learner.pars=list(cost=c(1,10),gamma=c(0.01,0.5))),
    workflowVariants(learner="rpartXse",
                     learner.pars=list(se=c(0,0.5,1)))
  ),
  EstimationTask("mse")
  )

## Get the iterations scores of svm.v2 on swiss
getScores(res,"svm.v2","swiss.Infant.Mortality")


## End(Not run)

performanceEstimation documentation built on May 2, 2019, 6:01 a.m.