| llama_n_threads | R Documentation |
Get number of threads for single-token generation
llama_n_threads(ctx)
ctx |
Context handle returned by [llama_new_context] |
An integer scalar: current thread count for generation.
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.