SpacyTokenizer: SpacyTokenizer

View source: R/text_core.R

SpacyTokenizerR Documentation

SpacyTokenizer

Description

Spacy tokenizer for 'lang'

Usage

SpacyTokenizer(lang = "en", special_toks = NULL, buf_sz = 5000)

Arguments

lang

language

special_toks

special tokenizers

buf_sz

buffer size

Value

none


EagerAI/fastai documentation built on April 16, 2024, 12:01 p.m.