ggml_flash_attn_ext_add_sinks: Attach Attention Sinks to a Flash-Attention Node

View source: R/operations.R

ggml_flash_attn_ext_add_sinksR Documentation

Attach Attention Sinks to a Flash-Attention Node

Description

Adds per-head "sink" logits, an always-available extra key that lets a query attend to nothing in particular.

Usage

ggml_flash_attn_ext_add_sinks(tensor, sinks)

Arguments

tensor

A flash-attention node

sinks

Sink logits, one per head

Value

The tensor (for chaining)

See Also

ggml_soft_max_add_sinks


ggmlR documentation built on Oct. 23, 2026, 1:07 a.m.