View source: R/plotCritDifferences.R
generateCritDifferencesData | R Documentation |
Generates data that can be used to plot a
critical differences plot. Computes the critical differences according
to either the
"Bonferroni-Dunn"
test or the "Nemenyi"
test.
"Bonferroni-Dunn"
usually yields higher power as it does not
compare all algorithms to each other, but all algorithms to a
baseline
instead.
Learners are drawn on the y-axis according to their average rank.
For test = "nemenyi"
a bar is drawn, connecting all groups of not
significantly different learners.
For test = "bd"
an interval is drawn arround the algorithm selected
as a baseline. All learners within this interval are not signifcantly different
from the baseline.
Calculation:
CD = q_{\alpha} \sqrt{\left(\frac{k(k+1)}{6N}\right)}
Where q_\alpha
is based on the studentized range statistic.
See references for details.
generateCritDifferencesData(
bmr,
measure = NULL,
p.value = 0.05,
baseline = NULL,
test = "bd"
)
bmr |
(BenchmarkResult) |
measure |
(Measure) |
p.value |
( |
baseline |
( |
test |
( |
(critDifferencesData
). List containing:
data |
(data.frame) containing the info for the descriptive part of the plot |
friedman.nemenyi.test |
(list) of class |
cd.info |
(list) containing info on the critical difference and its positioning |
baseline |
|
p.value |
p.value used for the PMCMRplus::frdAllPairsNemenyiTest and for computation of the critical difference |
Other generate_plot_data:
generateCalibrationData()
,
generateFeatureImportanceData()
,
generateFilterValuesData()
,
generateLearningCurveData()
,
generatePartialDependenceData()
,
generateThreshVsPerfData()
,
plotFilterValues()
Other benchmark:
BenchmarkResult
,
batchmark()
,
benchmark()
,
convertBMRToRankMatrix()
,
friedmanPostHocTestBMR()
,
friedmanTestBMR()
,
getBMRAggrPerformances()
,
getBMRFeatSelResults()
,
getBMRFilteredFeatures()
,
getBMRLearnerIds()
,
getBMRLearnerShortNames()
,
getBMRLearners()
,
getBMRMeasureIds()
,
getBMRMeasures()
,
getBMRModels()
,
getBMRPerformances()
,
getBMRPredictions()
,
getBMRTaskDescs()
,
getBMRTaskIds()
,
getBMRTuneResults()
,
plotBMRBoxplots()
,
plotBMRRanksAsBarChart()
,
plotBMRSummary()
,
plotCritDifferences()
,
reduceBatchmarkResults()
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.