ag_dtype: Set the default floating-point precision for ag_* GPU...

View source: R/ag_device.R

ag_dtypeR Documentation

Set the default floating-point precision for ag_* GPU operations

Description

Controls the dtype used when uploading tensors to the ggml backend. "bf16" halves memory usage vs "f32" with minimal accuracy loss. Backward pass always uses f32 R matrices regardless of this setting.

Usage

ag_dtype(dtype)

Arguments

dtype

"f32" (default), "f16", or "bf16"

Value

Invisibly the previous dtype string


ggmlR documentation built on July 14, 2026, 1:08 a.m.