improvedResiduals: Estimate the significance of the reduction of predicted...

In FRESA.CAD: Feature Selection Algorithms for Computer Aided Diagnosis

Estimate the significance of the reduction of predicted residuals

Description

This function will test the hypothesis that, given a set of two residuals (new vs. old), the new ones are better than the old ones as measured with non-parametric tests. Four p-values are provided: one for the binomial sign test, one for the paired Wilcoxon rank-sum test, one for the paired t-test, and one for the F-test. The proportion of subjects that improved their residuals, the proportion that worsen their residuals, and the net residual improvement (NeRI) will be returned.

Usage

	improvedResiduals(oldResiduals,
	                  newResiduals,
	                  testType = c("Binomial", "Wilcox", "tStudent", "Ftest"))

Arguments

oldResiduals	A vector with the residuals of the original model
newResiduals	A vector with the residuals of the new model
testType	Type of non-parametric test to be evaluated: Binomial test ("Binomial"), Wilcoxon rank-sum test ("Wilcox"), Student's t-test ("tStudent"), or F-test ("Ftest")

Details

This function will test the hypothesis that the new residuals are "better" than the old residuals. To test this hypothesis, four types of tests are performed:

1. The paired t-test, which compares the absolute value of the residuals

2. The paired Wilcoxon rank-sum test, which compares the absolute value of residuals

3. The binomial sign test, which evaluates whether the number of subjects with improved residuals is greater than the number of subjects with worsened residuals

4. The F-test, which is the standard test for evaluating whether the residual variance is "better" in the new residuals.

The proportions of subjects that improved and worsen their residuals are returned, and so is the NeRI.

Value

p1	Proportion of subjects that improved their residuals to the total number of subjects
p2	Proportion of subjects that worsen their residuals to the total number of subjects
NeRI	The net residual improvement (p1-p2)
p.value	The one tail p-value of the test specified in testType
BinP.value	The p-value associated with a significant improvement in residuals
WilcoxP.value	The single sided p-value of the Wilcoxon rank-sum test comparing the absolute values of the new and old residuals
tP.value	The single sided p-value of the paired t-test comparing the absolute values of the new and old residuals
FP.value	The single sided p-value of the F-test comparing the residual variances of the new and old residuals

Author(s)

Jose G. Tamez-Pena and Antonio Martinez-Torteya

FRESA.CAD documentation built on Nov. 25, 2023, 1:07 a.m.