| ggml_flash_attn_ext_add_sinks | R Documentation |
Adds per-head "sink" logits, an always-available extra key that lets a query attend to nothing in particular.
ggml_flash_attn_ext_add_sinks(tensor, sinks)
tensor |
A flash-attention node |
sinks |
Sink logits, one per head |
The tensor (for chaining)
ggml_soft_max_add_sinks
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.