| ggml_flash_attn_ext_set_prec | R Documentation |
Sets the precision a ggml_flash_attn_ext() node computes in.
GGML_PREC_F32 raises accuracy at some cost in speed.
ggml_flash_attn_ext_set_prec(tensor, prec)
tensor |
A flash-attention node |
prec |
Precision constant |
The tensor (for chaining)
ggml_flash_attn_ext_get_prec
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.