text_tokenize_lines: generic to tokenize text into lines

Description Usage Arguments

View source: R/text_tokenize.R

Description

generic to tokenize text into lines

text_tokenize default

Usage

1
2
3
4
text_tokenize_lines(string, non_token = FALSE)

## Default S3 method:
text_tokenize_lines(string, non_token = FALSE)

Arguments

string

the text to be tokenized

non_token

whether or not token as well as non tokens shall be returned.


stringb documentation built on Jan. 26, 2021, 1:07 a.m.