Man pages for macmillancontentscience/morphemepiece
Morpheme Tokenization
| dot-infer_case_from_vocab | Determine Vocabulary Casedness |
| dot-mp_tokenize_single_string | Tokenize an Input Word-by-word |
| dot-mp_tokenize_word | Tokenize a Word |
| dot-mp_tokenize_word_bidir | Tokenize a Word Bidirectionally |
| dot-mp_tokenize_word_lookup | Tokenize a Word Including Lookup |
| dot-new_morphemepiece_vocabulary | Constructor for Class morphemepiece_vocabulary |
| dot-process_mp_vocab | Process a Morphemepiece Vocabulary for Tokenization |
| dot-validate_morphemepiece_vocabulary | Validator for Objects of Class morphemepiece_vocabulary |
| load_lookup | Load a morphemepiece lookup file |
| load_or_retrieve_lookup | Load a lookup file, or retrieve from cache |
| load_or_retrieve_vocab | Load a vocabulary file, or retrieve from cache |
| load_vocab | Load a vocabulary file |
| morphemepiece_cache_dir | Retrieve Directory for Morphemepiece Cache |
| morphemepiece-package | morphemepiece: Morpheme Tokenization |
| morphemepiece_tokenize | Tokenize Sequence with Morpheme Pieces |
| prepare_vocab | Format a Token List as a Vocabulary |
| reexports | Objects exported from other packages |
| set_morphemepiece_cache_dir | Set a Cache Directory for Morphemepiece |
