llama_n_ubatch: Get physical micro-batch size

View source: R/llama.R

llama_n_ubatchR Documentation

Get physical micro-batch size

Description

Get physical micro-batch size

Usage

llama_n_ubatch(ctx)

Arguments

ctx

Context handle returned by [llama_new_context]

Value

An integer scalar: the physical micro-batch size.


llamaR documentation built on May 28, 2026, 1:06 a.m.