split_on_punc: Split text on punctuation.
In jonathanbratt/RBERT: R Implementation of BERT
split_on_punc R Documentation
Split text on punctuation.
Description
(R implementation of BasicTokenizer._run_split_on_punc from
BERT: tokenization.py.)
Usage
split_on_punc(text)
Arguments
text
A character scalar, encoded as utf-8.
Value
The input text as a character vector, split on punctuation
characters.
jonathanbratt/RBERT documentation built on Jan. 26, 2023, 4:15 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| split_on_punc | R Documentation |
Split text on punctuation.
Description
(R implementation of BasicTokenizer._run_split_on_punc from BERT: tokenization.py.)
Usage
split_on_punc(text)
Arguments
text |
A character scalar, encoded as utf-8. |
Value
The input text as a character vector, split on punctuation characters.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.