Nothing
morphemepiece: Morpheme Tokenization
Tokenize text into morphemes. The morphemepiece algorithm uses a lookup table to determine the morpheme breakdown of words, and falls back on a modified wordpiece tokenization algorithm for words not found in the lookup table.
Getting started
Browse package contents
Package details |
|
|---|---|
| Author | Jonathan Bratt [aut, cre] (<https://orcid.org/0000-0003-2859-0076>), Jon Harmon [aut] (<https://orcid.org/0000-0003-4781-4346>), Bedford Freeman & Worth Pub Grp LLC DBA Macmillan Learning [cph] |
| Maintainer | Jonathan Bratt <jonathan.bratt@macmillan.com> |
| License | Apache License (>= 2) |
| Version | 1.2.3 |
| URL | https://github.com/macmillancontentscience/morphemepiece |
| Package repository | View on CRAN |
| Installation |
Install the latest version of this package by entering the following in R:
|
Try the morphemepiece package in your browser
Any scripts or data that you put into this service are public.
