tokenize1: Tokenize1

Description Usage Arguments Value

View source: R/text_core.R

Description

Call 'TokenizeWithRules' with a single text

Usage

1
tokenize1(text, tok, rules = NULL, post_rules = NULL)

Arguments

text

text

tok

tok

rules

rules

post_rules

post_rules

Value

None


fastai documentation built on Oct. 25, 2021, 5:08 p.m.