whitespace_tokenize: Run basic whitespace cleaning and splitting on a piece of...
In jonathanbratt/RBERT: R Implementation of BERT
whitespace_tokenize R Documentation
Run basic whitespace cleaning and splitting on a piece of text.
Description
Run basic whitespace cleaning and splitting on a piece of text.
Usage
whitespace_tokenize(text)
Arguments
text
Character scalar to tokenize.
Value
Character vector of tokens.
Examples
whitespace_tokenize(text = " some\ttext \n with whitespace ")
jonathanbratt/RBERT documentation built on Jan. 26, 2023, 4:15 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| whitespace_tokenize | R Documentation |
Run basic whitespace cleaning and splitting on a piece of text.
Description
Run basic whitespace cleaning and splitting on a piece of text.
Usage
whitespace_tokenize(text)
Arguments
text |
Character scalar to tokenize. |
Value
Character vector of tokens.
Examples
whitespace_tokenize(text = " some\ttext \n with whitespace ")
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.