| llama_n_threads_batch | R Documentation |
Get number of threads for batch processing
llama_n_threads_batch(ctx)
ctx |
Context handle returned by [llama_new_context] |
An integer scalar: current thread count for prompt encoding.
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.