tokenize1: Tokenize1

View source: R/text_core.R

tokenize1R Documentation

Tokenize1

Description

Call 'TokenizeWithRules' with a single text

Usage

tokenize1(text, tok, rules = NULL, post_rules = NULL)

Arguments

text

text

tok

tok

rules

rules

post_rules

post_rules

Value

None


henry090/fastai documentation built on April 14, 2024, 9:28 a.m.