ROCR: Visualizing the Performance of Scoring Classifiers

ROC graphs, sensitivity/specificity curves, lift charts, and precision/recall plots are popular examples of trade-off visualizations for specific pairs of performance measures. ROCR is a flexible tool for creating cutoff-parameterized 2D performance curves by freely combining two from over 25 performance measures (new performance measures can be added using a standard interface). Curves from different cross-validation or bootstrapping runs can be averaged by different methods, and standard deviations, standard errors or box plots can be used to visualize the variability across the runs. The parameterization can be visualized by printing cutoff values at the corresponding curve positions, or by coloring the curve according to cutoff. All components of a performance plot can be quickly adjusted using a flexible parameter dispatching mechanism. Despite its flexibility, ROCR is easy to use, with only three commands and reasonable default values for all optional parameters.

Author
Tobias Sing, Oliver Sander, Niko Beerenwinkel, Thomas Lengauer
Date of publication
2015-03-26 17:12:17
Maintainer
Tobias Sing <tobias.sing@gmail.com>
License
GPL (>= 2)
Version
1.0-7
URLs

View on CRAN

Man pages

performance
Function to create performance objects
performance-class
Class "performance"
plot-methods
Plot method for performance objects
prediction
Function to create prediction objects
prediction-class
Class "prediction"
ROCR.hiv
Data set: Support vector machines and neural networks applied...
ROCR.simple
Data set: Simple artificial prediction data for use with ROCR
ROCR.xval
Data set: Artificial cross-validation data for use with ROCR

Files in this package

ROCR
ROCR/inst
ROCR/inst/CITATION
ROCR/NAMESPACE
ROCR/demo
ROCR/demo/00Index
ROCR/demo/ROCR.R
ROCR/INSTALL
ROCR/NEWS
ROCR/data
ROCR/data/ROCR.simple.rda
ROCR/data/ROCR.xval.rda
ROCR/data/datalist
ROCR/data/ROCR.hiv.rda
ROCR/R
ROCR/R/performance_measures.R
ROCR/R/ROCR_aux.R
ROCR/R/prediction.R
ROCR/R/performance_plots.R
ROCR/R/zzz.R
ROCR/R/performance.R
ROCR/MD5
ROCR/README
ROCR/DESCRIPTION
ROCR/man
ROCR/man/ROCR.simple.Rd
ROCR/man/plot-methods.Rd
ROCR/man/prediction.Rd
ROCR/man/performance.Rd
ROCR/man/performance-class.Rd
ROCR/man/prediction-class.Rd
ROCR/man/ROCR.xval.Rd
ROCR/man/ROCR.hiv.Rd
ROCR/tools
ROCR/tools/README.unittests
ROCR/tools/unittests
ROCR/tools/unittests/XXXrunit.ROCR.aux.RXXX
ROCR/tools/unittests/runit.aux.r
ROCR/tools/unittests/testsuite.ROCR.R
ROCR/tools/unittests/runit.consistency.r
ROCR/tools/unittests/runit.simple.r