permutation_test: Compare Two Networks from Sequence Data using a Permutation...

View source: R/permutation.R

permutation_testR Documentation

Compare Two Networks from Sequence Data using a Permutation Test

Description

This function compares two networks built from sequence data using permutation tests. The function builds Markov models for two sequence objects, computes the transition probabilities, and compares them by performing permutation tests. It returns the differences in transition probabilities, effect sizes, estimated p-values, and confidence intervals.

Usage

permutation_test(x, ...)

## S3 method for class 'tna'
permutation_test(
  x,
  y,
  adjust = "none",
  iter = 1000,
  paired = FALSE,
  level = 0.05,
  measures = character(0),
  actor = NULL,
  ...
)

Arguments

x

A tna object containing sequence data for the first tna model. Grouped models with scaled edge weights, and their networks, are not resampled (an error of class tna_error_scaling). Two models with scaled edge weights are compared with a message (class tna_message_scaling): each is scaled on its own, so comparing them is not warranted.

...

Additional arguments passed to centralities().

y

A tna object containing sequence data for the second tna model.

adjust

A character string for the method to adjust p-values with for multiple comparisons. The default is "none" for no adjustment. See the method argument of stats::p.adjust() for details and available adjustment methods. The edge p-values are corrected over the edges tested: the transitions present in either network, each pair of a co-occurrence network counted once. A transition absent from both keeps its p-value of 1.

iter

An integer giving the number of permutations to perform. The default is 1000.

paired

A logical value. If TRUE, perform paired permutation tests; if FALSE, perform unpaired tests. The default is FALSE.

level

A numeric value giving the significance level for the permutation tests. The default is 0.05.

measures

A character vector of centrality measures to test. See centralities() for a list of available centrality measures.

actor

An optional actor identifier for sequences nested in actors (for example, several sessions per student). Either a character string naming a non-sequence column of the data the models were built from (such as a column of meta_data from prepare_data()), or a vector with one identifier per sequence (the sequences of x first, then those of y). When given, the permutation respects the nesting: actors whose sequences are all in one group are reassigned between the groups as whole units, and the sequences of actors present in both groups are shuffled within the actor (Good, 2005). A warning is given when the actors allow too few distinct permutations to reach level. Cannot be combined with paired = TRUE. The default NULL permutes single sequences.

Value

A tna_permutation object which is a list with two elements: edges and centralities (NULL when measures is empty). Both contain the following elements:

  • stats: A data.frame of original differences, effect sizes, and estimated p-values, with one row per edge (columns edge_name, diff_true, effect_size, p_value) or per state and centrality measure (columns state, centrality, diff_true, effect_size, p_value). The effect size is the observed difference divided by the standard deviation of the differences of the permuted samples, and NA when the permuted differences do not vary.

  • diffs_true: The differences in the data: a matrix for the edges, and a data.frame with one row per state and one column per measure for the centralities.

  • diffs_sig: The same as diffs_true with the non-significant differences set to zero.

Use summary.tna_permutation() for the results as a tidy table.

References

Good, P. (2005). Permutation, Parametric, and Bootstrap Tests of Hypotheses (3rd ed.). Springer.

See Also

Validation functions bootstrap(), deprune(), estimate_cs(), markov_order(), permutation_test.group_tna(), plot.group_tna_bootstrap(), plot.group_tna_permutation(), plot.group_tna_stability(), plot.tna_bootstrap(), plot.tna_markov_order(), plot.tna_permutation(), plot.tna_reliability(), plot.tna_stability(), print.group_tna_bootstrap(), print.group_tna_permutation(), print.group_tna_stability(), print.summary.group_tna_bootstrap(), print.summary.tna_bootstrap(), print.summary.tna_markov_order(), print.tna_bootstrap(), print.tna_markov_order(), print.tna_permutation(), print.tna_reliability(), print.tna_stability(), prune(), pruning_details(), reliability(), reprune(), summary.group_tna_bootstrap(), summary.tna_bootstrap(), summary.tna_markov_order(), summary.tna_permutation(), summary.tna_reliability(), summary.tna_stability()

Examples

model_x <- tna(head(group_regulation, 200))
model_y <- tna(tail(group_regulation, 200))
# Small number of iterations for CRAN
permutation_test(model_x, model_y, iter = 20)


tna documentation built on Nov. 17, 2026, 1:06 a.m.