tokenize_test: Test tokenize function (debugging)
In localLLM: Running Local LLMs with 'llama.cpp' Backend
tokenize_test R Documentation
Test tokenize function (debugging)
Description
Test tokenize function (debugging)
Usage
tokenize_test(model)
Arguments
model
A model object
Value
Integer vector of tokens for "H"
localLLM documentation built on Nov. 3, 2026, 1:09 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| tokenize_test | R Documentation |
Test tokenize function (debugging)
Description
Test tokenize function (debugging)
Usage
tokenize_test(model)
Arguments
model |
A model object |
Value
Integer vector of tokens for "H"
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.