ggml_soft_max_ext_back: Softmax Backward Extended (Graph)

View source: R/operations.R

ggml_soft_max_ext_backR Documentation

Softmax Backward Extended (Graph)

Description

Backward pass for extended softmax operation.

Usage

ggml_soft_max_ext_back(ctx, a, b, scale = 1, max_bias = 0)

Arguments

ctx

GGML context

a

Softmax output tensor (from forward pass)

b

Gradient tensor from upstream

scale

Scale factor (same as forward pass)

max_bias

Maximum ALiBi bias (same as forward pass)

Value

Gradient tensor for the input


ggmlR documentation built on July 14, 2026, 1:08 a.m.