API for wordpiece
R Implementation of Wordpiece Tokenization
| Global functions | |
|---|---|
| %fin% | Man page |
| %||% | Man page |
| .get_casedness | Man page Source code |
| .get_casedness.character | Man page Source code |
| .get_casedness.default | Man page Source code |
| .get_casedness.wordpiece_vocabulary | Man page Source code |
| .infer_case_from_vocab | Man page Source code |
| .new_wordpiece_vocabulary | Man page Source code |
| .onLoad | Source code |
| .process_vocab | Man page Source code |
| .process_vocab.character | Man page Source code |
| .process_vocab.default | Man page Source code |
| .process_vocab.wordpiece_vocabulary | Man page Source code |
| .process_wp_vocab | Man page Source code |
| .process_wp_vocab.character | Man page Source code |
| .process_wp_vocab.default | Man page Source code |
| .process_wp_vocab.integer | Man page Source code |
| .process_wp_vocab.wordpiece_vocabulary | Man page Source code |
| .validate_wordpiece_vocabulary | Man page Source code |
| .wp_tokenize_single_string | Man page Source code |
| .wp_tokenize_word | Man page Source code |
| load_or_retrieve_vocab | Man page Source code |
| load_vocab | Man page Source code |
| prepare_vocab | Man page Source code |
| reexports | Man page |
| set_wordpiece_cache_dir | Man page Source code |
| wordpiece_cache_dir | Man page Source code |
| wordpiece_tokenize | Man page Source code |
| wordpiece_vocab | Man page |
