| ggml_soft_max_ext_back | R Documentation |
Backward pass for extended softmax operation.
ggml_soft_max_ext_back(ctx, a, b, scale = 1, max_bias = 0)
ctx |
GGML context |
a |
Softmax output tensor (from forward pass) |
b |
Gradient tensor from upstream |
scale |
Scale factor (same as forward pass) |
max_bias |
Maximum ALiBi bias (same as forward pass) |
Gradient tensor for the input
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.