Description Usage Arguments Value See Also
View source: R/preprocessing.R
One-hot encode a text into a list of word indexes in a vocabulary of size n.
1 2 3 4 5 6 7 | text_one_hot(
text,
n,
filters = "!\"#$%&()*+,-./:;<=>?@[\\]^_`{|}~\t\n",
lower = TRUE,
split = " "
)
|
text |
Input text (string). |
n |
Size of vocabulary (integer) |
filters |
Sequence of characters to filter out such as punctuation. Default includes basic punctuation, tabs, and newlines. |
lower |
Whether to convert the input to lowercase. |
split |
Sentence split marker (string). |
List of integers in [1, n]
. Each integer encodes a word (unicity
non-guaranteed).
Other text preprocessing:
make_sampling_table()
,
pad_sequences()
,
skipgrams()
,
text_hashing_trick()
,
text_to_word_sequence()
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.