| llama_n_batch | R Documentation |
Get logical batch size
llama_n_batch(ctx)
ctx |
Context handle returned by [llama_new_context] |
An integer scalar: the logical batch size (max tokens per 'llama_decode' call).
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.