Nothing
NEWS.md
In tokenizers.bpe: Byte Pair Encoding Text Tokenization
CHANGES IN tokenizers.bpe VERSION 0.1.3
- Update parallel-hashmap to 1.3.11 which fixes C++17 deprecations about rebind, construct, destroy
CHANGES IN tokenizers.bpe VERSION 0.1.2
- Drop C++11 specification in Makevars
CHANGES IN tokenizers.bpe VERSION 0.1.1
- replace move with std::move to fix R CMD check warning on recent versions of clang compilers
CHANGES IN tokenizers.bpe VERSION 0.1.0
- Initial package based on VKCOM/YouTokenToMe version 1.0.1 commit 16fcf1d8e208f9bbbc9f522e83e6ff81708dba73
Try the tokenizers.bpe package in your browser
Any scripts or data that you put into this service are public.
tokenizers.bpe documentation built on Sept. 16, 2023, 1:06 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
CHANGES IN tokenizers.bpe VERSION 0.1.3
- Update parallel-hashmap to 1.3.11 which fixes C++17 deprecations about rebind, construct, destroy
CHANGES IN tokenizers.bpe VERSION 0.1.2
- Drop C++11 specification in Makevars
CHANGES IN tokenizers.bpe VERSION 0.1.1
- replace move with std::move to fix R CMD check warning on recent versions of clang compilers
CHANGES IN tokenizers.bpe VERSION 0.1.0
- Initial package based on VKCOM/YouTokenToMe version 1.0.1 commit 16fcf1d8e208f9bbbc9f522e83e6ff81708dba73
Try the tokenizers.bpe package in your browser
Any scripts or data that you put into this service are public.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.