llama_n_batch: Get logical batch size

View source: R/llama.R

llama_n_batchR Documentation

Get logical batch size

Description

Get logical batch size

Usage

llama_n_batch(ctx)

Arguments

ctx

Context handle returned by [llama_new_context]

Value

An integer scalar: the logical batch size (max tokens per 'llama_decode' call).


llamaR documentation built on May 28, 2026, 1:06 a.m.