ggml_swiglu_split: SwiGLU Split (Graph)

View source: R/operations.R

ggml_swiglu_splitR Documentation

SwiGLU Split (Graph)

Description

Creates a graph node for SwiGLU with separate input and gate tensors.

Usage

ggml_swiglu_split(ctx, a, b)

Arguments

ctx

GGML context

a

Input tensor (the values to be gated)

b

Gate tensor (same shape as a)

Details

Formula: output = SiLU(a) * b

Value

Tensor with same shape as input tensors


ggmlR documentation built on July 14, 2026, 1:08 a.m.