CPEfficiency: Computes efficiency of a conformal predictor, which is...

In conformalClassification: Transductive and Inductive Conformal Predictions for Classification Problems

Description

Computes efficiency of a conformal predictor, which is defined as the ratio of predictions with more than one class over the size of the testset

Usage

CPEfficiency(matPValues, testLabels, sigfLevel = 0.05)

Arguments

matPValues	Matrix of p-values
testLabels	True labels for the test-set
sigfLevel	Significance level

Value

The efficiency

See Also

CPCalibrationPlot, CPErrorRate, CPValidity, CPObsFuzziness.

Examples

## load the library
library(mlbench)
#library(caret)
library(conformalClassification)

## load the DNA dataset
data(DNA)
originalData <- DNA

## make sure first column is always the label and class labels are always 1, 2, ...
nrAttr = ncol(originalData) #no of attributes
tempColumn = originalData[, 1]
originalData[, 1] = originalData[, nrAttr]
originalData[, nrAttr] = tempColumn
originalData[, 1] = as.factor(originalData[, 1])
originalData[, 1] = as.numeric(originalData[, 1])

## partition the data into training and test set
#result = createDataPartition(originalData[, 1], p = 0.8, list = FALSE)
size = nrow(originalData)
result = sample(1:size,  0.8*size)

trainingSet = originalData[result, ]
testSet = originalData[-result, ]

##ICP classification
pValues = ICPClassification(trainingSet, testSet)
testLabels = testSet[,1]
CPEfficiency(pValues, testLabels)

conformalClassification documentation built on May 2, 2019, 8:19 a.m.