tokenlist_jp: Token list for Japanese character

View source: R/tokenlist.R

tokenlist_jpR Documentation

Token list for Japanese character

Description

Token list for Japanese character

Usage

tokenlist_jp(tokens = list())

Arguments

tokens

list

Examples

## Not run: 
tokens <- list(purrr::set_names(c(intToUtf8(c(26519, 27278))),
               c(intToUtf8(c(21517, 35422)))))
tokenlist_jp(tokens)

## End(Not run)

uribo/washoku documentation built on Sept. 20, 2022, 4:33 a.m.