dot-infer_case_from_vocab | Determine Vocabulary Casedness |
dot-mp_tokenize_single_string | Tokenize an Input Word-by-word |
dot-mp_tokenize_word | Tokenize a Word |
dot-mp_tokenize_word_bidir | Tokenize a Word Bidirectionally |
dot-mp_tokenize_word_lookup | Tokenize a Word Including Lookup |
dot-new_morphemepiece_vocabulary | Constructor for Class morphemepiece_vocabulary |
dot-process_mp_vocab | Process a Morphemepiece Vocabulary for Tokenization |
dot-validate_morphemepiece_vocabulary | Validator for Objects of Class morphemepiece_vocabulary |
load_lookup | Load a morphemepiece lookup file |
load_or_retrieve_lookup | Load a lookup file, or retrieve from cache |
load_or_retrieve_vocab | Load a vocabulary file, or retrieve from cache |
load_vocab | Load a vocabulary file |
morphemepiece_cache_dir | Retrieve Directory for Morphemepiece Cache |
morphemepiece-package | morphemepiece: Morpheme Tokenization |
morphemepiece_tokenize | Tokenize Sequence with Morpheme Pieces |
prepare_vocab | Format a Token List as a Vocabulary |
reexports | Objects exported from other packages |
set_morphemepiece_cache_dir | Set a Cache Directory for Morphemepiece |
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.