permutationScoreModel: Empirical permutation test of significance of...

In sigr: Succinct and Correct Statistical Summaries for Reports

Empirical permutation test of significance of scoreFn(modelValues,yValues) >= scoreFn(modelValues,perm(yValues)).

Description

Treat permutation re-samples as similar to bootstrap replications.

Usage

permutationScoreModel(
  modelValues,
  yValues,
  scoreFn,
  ...,
  na.rm = FALSE,
  returnScores = FALSE,
  nRep = 100,
  parallelCluster = NULL
)

Arguments

modelValues	numeric array of predictions.
yValues	numeric/logical array of outcomes, dependent, or truth values
scoreFn	function with signature scoreFn(modelValues,yValues) returning scalar numeric score.
...	not used, forces later arguments to be bound by name
na.rm	logical, if TRUE remove NA values
returnScores	logical if TRUE return detailed permutedScores
nRep	integer number of repititions to perform
parallelCluster	optional snow-style parallel cluster.

Value

summaries

Examples

set.seed(25325)
y <- 1:5
m <- c(1,1,2,2,2)
cor.test(m,y,alternative='greater')
f <- function(modelValues,yValues) cor(modelValues,yValues)
permutationScoreModel(m,y,f)

sigr documentation built on Aug. 20, 2023, 9:06 a.m.