macmillancontentscience/piecemaker: Tools for Preparing Text for Tokenizers
Tokenizers break text into pieces that are more usable by machine learning models. Many tokenizers share some preparation steps. This package provides those shared steps, along with a simple tokenizer.
Getting started
Browse package contents
Package details |
|
|---|---|
| Maintainer | |
| License | Apache License (>= 2) |
| Version | 1.0.2.9000 |
| URL | https://github.com/macmillancontentscience/piecemaker https://macmillancontentscience.github.io/piecemaker/ |
| Package repository | View on GitHub |
| Installation |
Install the latest version of this package by entering the following in R:
|
