CPErrorRate: Computes error rate of a conformal predictor, which is...

Description Usage Arguments Value See Also Examples

View source: R/common.R

Description

Computes error rate of a conformal predictor, which is defined as the ratio of predictions with missing true class lables over the size of the testset

Usage

1
CPErrorRate(matPValues, testLabels, sigfLevel = 0.05)

Arguments

matPValues

Matrix of p-values

testLabels

True labels for the test-set

sigfLevel

Significance level

Value

The error rate

See Also

CPCalibrationPlot, CPEfficiency, CPValidity, CPObsFuzziness.

Examples

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
## load the library
library(mlbench)
#library(caret)
library(conformalClassification)

## load the DNA dataset
data(DNA)
originalData <- DNA

## make sure first column is always the label and class labels are always 1, 2, ...
nrAttr = ncol(originalData) #no of attributes
tempColumn = originalData[, 1]
originalData[, 1] = originalData[, nrAttr]
originalData[, nrAttr] = tempColumn
originalData[, 1] = as.factor(originalData[, 1])
originalData[, 1] = as.numeric(originalData[, 1])

## partition the data into training and test set
#result = createDataPartition(originalData[, 1], p = 0.8, list = FALSE)
size = nrow(originalData)
result = sample(1:size,  0.8*size)

trainingSet = originalData[result, ]
testSet = originalData[-result, ]

##ICP classification
pValues = ICPClassification(trainingSet, testSet)
testLabels = testSet[,1]
CPErrorRate(pValues, testLabels)

conformalClassification documentation built on Dec. 23, 2017, 5:32 p.m.