Files in morphemepiece
Morpheme Tokenization
MD5
NEWS.md
README.md
NAMESPACE
DESCRIPTION
R/tokenize.R
R/vocab.R
R/zzz.R
R/imports.R
R/utils.R
R/00package_help.R
inst/doc/algorithm_test.R
inst/doc/algorithm_test.Rmd
inst/doc/generating_vocab.html
inst/doc/generating_vocab.Rmd
inst/doc/generating_vocab.R
inst/doc/algorithm_test.html
build/vignette.rds
tests/testthat.R
tests/testthat/test-morphemepiece.R
tests/testthat/test-vocab.R
vignettes/algorithm_test.Rmd
vignettes/words_vs_tokens1.png
vignettes/words_vs_tokens2.png
vignettes/generating_vocab.Rmd
vignettes/make_vocab_and_lookup.R
man/dot-mp_tokenize_word_lookup.Rd
man/dot-mp_tokenize_word_bidir.Rd
man/reexports.Rd
man/dot-mp_tokenize_single_string.Rd
man/load_or_retrieve_vocab.Rd
man/set_morphemepiece_cache_dir.Rd
man/load_or_retrieve_lookup.Rd
man/load_vocab.Rd
man/dot-validate_morphemepiece_vocabulary.Rd
man/load_lookup.Rd
man/dot-infer_case_from_vocab.Rd
man/prepare_vocab.Rd
man/dot-mp_tokenize_word.Rd
man/dot-process_mp_vocab.Rd
man/morphemepiece_cache_dir.Rd
man/morphemepiece-package.Rd
man/dot-new_morphemepiece_vocabulary.Rd
man/morphemepiece_tokenize.Rd
