| llama_n_ubatch | R Documentation |
Get physical micro-batch size
llama_n_ubatch(ctx)
ctx |
Context handle returned by [llama_new_context] |
An integer scalar: the physical micro-batch size.
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.