ggml_flash_attn_ext_set_prec: Set Flash-Attention Precision

View source: R/operations.R

ggml_flash_attn_ext_set_precR Documentation

Set Flash-Attention Precision

Description

Sets the precision a ggml_flash_attn_ext() node computes in. GGML_PREC_F32 raises accuracy at some cost in speed.

Usage

ggml_flash_attn_ext_set_prec(tensor, prec)

Arguments

tensor

A flash-attention node

prec

Precision constant

Value

The tensor (for chaining)

See Also

ggml_flash_attn_ext_get_prec


ggmlR documentation built on Oct. 23, 2026, 1:07 a.m.