token_permutation.all: Token Permutations - All
In duncankmckinnon/ezRnlp: Easy framework for plug and play NLP

Description Usage Arguments Value Examples

Collects all tokens that could result from performing any edit operation on the input token using a more efficient single-pass implementation

1	token_permutation.all(token, split = TRUE, simplify = FALSE)

`token`	either 1 token or a pre-split set of ordered letters that make up the token
`split`	whether the input token needs to be split into individual letters or not - default = TRUE
`simplify`	whether to return a simplified vector of the token permutations, or a list containing the permutations for each separate operation (delete, replace, insert) - default = FALSE

by default returns a list with the separate permutations for 1 delete, replace and insert if simplify is true, returns a character vector with each possible permutation of the original token after 1 operation

1
2
3

token_permutation.all('sometoken')
token_permutation.all(c('s','o','m','e','t','o','k','e','n'), split = FALSE)
token_permutation.all('sometoken', simplify = TRUE)