space_tokenizer: Returns vector of tokens, tokenization by space

Description Usage Arguments Value

View source: R/tokenization.R

Description

Returns vector of tokens, tokenization by space

Usage

1
space_tokenizer(input, sep = " ")

Arguments

input

String to tokenize

sep

Separator to split (default - space)

Value

vector of words


perfail-stud/Rstudfile documentation built on Dec. 22, 2021, 7:43 a.m.