test_absolute_es: Tests for Absolute Effect Size

In mufcItay/weaknull: A Nonparametric Frequentist Statistical Framework to Test Nondirectional Null Hypotheses

Tests for Absolute Effect Size

Description

The function tests whether the absolute effect size is larger than expected by chance, using bootstrapping and permuting each participants' independent variable labels. The function accepts a dataset in long format with specific columns: identifier ('idv'), independent and dependent variables (iv and dv, respectively). For each participant, the function calculates the absolute effect size. All levels of the independent variable must be included under each identifier.

Usage

test_absolute_es(
  data,
  idv = "id",
  dv = "rt",
  iv = "condition",
  summary_function = lsr::cohensD,
  perm_repetitions = 100,
  null_dist_samples = 10^4
)

Arguments

data	The dataset to analyze
idv	The name of the participant identifier column.
dv	The dependent variable to apply the summary function (summary_function) to. For multiple dependent variables use a string list with the names of each dependent variable (e.g., c('dv1','dv2')),
iv	Labels of an independent variable, indicating the different levels under which the dependent variable ('dv') is expected to differ .
summary_function	The summary function to apply to the dependent variables ('dv') as a function of the independent variable ('iv') for each participant ('idv').
null_dist_samples	The number of samples taken from the null distribution.

Value

A list including the results of the function

• p - The p_value of the absolute effect size against a bootstrapped null distribution. the p-value is adjusted according to (B + 1) / (M + 1), see Phipson & Smyth, 2010.

• statistic - The group-level statistic describing the average absolute effect size

• null_dist - A numerical vector of samples of absolute effect sizes under the null hypothesis (no consistent difference in the dependent variable ('dv') between the levels of the independent variable ('iv')).

• absolute_es_per_id - Absolute effect sizefor each participant.

See Also

[signcon::get_absolute_es()]

mufcItay/weaknull documentation built on Jan. 29, 2025, 7:28 p.m.