space_cjk: Add Spaces Around CJK Ideographs
In macmillancontentscience/piecemaker: Tools for Preparing Text for Tokenizers
space_cjk R Documentation
Add Spaces Around CJK Ideographs
Description
To tokenize Chinese, Japanese, and Korean (CJK) characters, it's convenient
to add spaces around the characters.
Usage
space_cjk(text)
Arguments
text
A character vector to clean.
Value
A character vector the same length as the input text, with spaces
added between ideographs.
Examples
to_space <- intToUtf8(13312:13320)
to_space
space_cjk(to_space)
macmillancontentscience/piecemaker documentation built on July 1, 2023, 8:12 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| space_cjk | R Documentation |
Add Spaces Around CJK Ideographs
Description
To tokenize Chinese, Japanese, and Korean (CJK) characters, it's convenient to add spaces around the characters.
Usage
space_cjk(text)
Arguments
text |
A character vector to clean. |
Value
A character vector the same length as the input text, with spaces added between ideographs.
Examples
to_space <- intToUtf8(13312:13320)
to_space
space_cjk(to_space)
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.