Description Usage Arguments Details Value See Also Examples
givitiCalibrationTest
performs the calibration test associated to the
calibration belt.
1 2 | givitiCalibrationTest(o, e, devel, subset = NULL, thres = 0.95,
maxDeg = 4)
|
o |
A numeric vector representing the binary outcomes.
The elements must assume only the values 0 or 1. The predictions
in |
e |
A numeric vector containing the probabilities of the
model under evaluation. The elements must be numeric and between 0 and 1.
The lenght of the vector must be equal to the length of the vector |
devel |
A character string specifying if the model has been fit on
the same dataset under evaluation ( |
subset |
An optional boolean vector specifying the subset of observations to be considered. |
thres |
A numeric scalar between 0 and 1 representing 1 - the significance level adopted in the forward selection. By default is set to 0.95. |
maxDeg |
The maximum degree considered in the forward selection. By default is set to 4. |
The calibration belt and the associated test can be used both to evaluate the calibration of the model in external samples or in the development dataset. However, the two cases have different requirements. When a model is evaluated on independent samples, the calibration belt and the related test can be applied whatever is the method used to fit the model. Conversely, they can be used on the development set only if the model is fitted with logistic regression.
A list of class htest
containing the following components:
The value of the test's statistic.
The p-value of the test.
The vector of coefficients hypothesized under the null hypothesis, that is, the parameters corresponding to the bisector.
A character string describing the alternative hypothesis.
A character string indicating what type of calibration test (internal or external) was performed.
The estimate of the coefficients of the polynomial logistic regression.
A character string giving the name(s) of the data.
givitiCalibrationBelt
and plot.givitiCalibrationBelt
to compute and plot the calibaration belt.
1 2 3 4 5 6 7 8 9 | #Random by-construction well calibrated model
e <- runif(100)
o <- rbinom(100, size = 1, prob = e)
givitiCalibrationTest(o, e, "external")
#Random by-construction poorly calibrated model
e <- runif(100)
o <- rbinom(100, size = 1, prob = logistic(logit(e)+2))
givitiCalibrationTest(o, e, "external")
|
GiViTI calibration test - external validation
data: e = 'Predictions' and o = 'Binary outcome'
Stat = 0.91641, p-value = 0.6324
alternative hypothesis: two.sided
null values:
beta0 beta1
0 1
sample estimates:
beta0 beta1
-0.06316616 1.23200603
GiViTI calibration test - external validation
data: e = 'Predictions' and o = 'Binary outcome'
Stat = 31.42, p-value = 1.504e-07
alternative hypothesis: two.sided
null values:
beta0 beta1
0 1
sample estimates:
beta0 beta1
1.675654 1.253293
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.