fit_text_tokenizer: Update tokenizer internal vocabulary based on a list of texts...

Description Usage Arguments Note See Also

View source: R/preprocessing.R

Description

Update tokenizer internal vocabulary based on a list of texts or list of sequences.

Usage

1
fit_text_tokenizer(object, x)

Arguments

object

Tokenizer returned by text_tokenizer()

x

Vector/list of strings, or a generator of strings (for memory-efficiency); Alternatively a list of "sequence" (a sequence is a list of integer word indices).

Note

Required before using texts_to_sequences(), texts_to_matrix(), or sequences_to_matrix().

See Also

Other text tokenization: save_text_tokenizer(), sequences_to_matrix(), text_tokenizer(), texts_to_matrix(), texts_to_sequences_generator(), texts_to_sequences()


keras documentation built on Feb. 10, 2022, 1:08 a.m.