ggml_soft_max_add_sinks: Attach Attention Sinks to a Softmax Node

View source: R/operations.R

ggml_soft_max_add_sinksR Documentation

Attach Attention Sinks to a Softmax Node

Description

The ggml_soft_max_ext counterpart of ggml_flash_attn_ext_add_sinks.

Usage

ggml_soft_max_add_sinks(tensor, sinks)

Arguments

tensor

A softmax node

sinks

Sink logits, one per head

Value

The tensor (for chaining)


ggmlR documentation built on Oct. 23, 2026, 1:07 a.m.