ggml_flash_attn_back: Flash Attention Backward (Graph)
In ggmlR: 'GGML' Tensor Operations for Machine Learning
ggml_flash_attn_back R Documentation
Flash Attention Backward (Graph)
Description
Backward pass for Flash Attention.
Used during training to compute gradients through attention.
Usage
ggml_flash_attn_back(ctx, q, k, v, d, masked = TRUE)
Arguments
ctx
GGML context
q
Query tensor (same as forward pass)
k
Key tensor (same as forward pass)
v
Value tensor (same as forward pass)
d
Gradient tensor from upstream (same shape as forward output)
masked
Logical: whether causal masking was used in forward pass
Value
Gradient tensor
ggmlR documentation built on July 14, 2026, 1:08 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| ggml_flash_attn_back | R Documentation |
Flash Attention Backward (Graph)
Description
Backward pass for Flash Attention. Used during training to compute gradients through attention.
Usage
ggml_flash_attn_back(ctx, q, k, v, d, masked = TRUE)
Arguments
ctx |
GGML context |
q |
Query tensor (same as forward pass) |
k |
Key tensor (same as forward pass) |
v |
Value tensor (same as forward pass) |
d |
Gradient tensor from upstream (same shape as forward output) |
masked |
Logical: whether causal masking was used in forward pass |
Value
Gradient tensor
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.