nnf_glu: Glu
In torch: Tensors and Neural Networks with 'GPU' Acceleration
View source: R/nnf-activation.R
nnf_glu R Documentation
Glu
Description
The gated linear unit. Computes:
Usage
nnf_glu(input, dim = -1)
Arguments
input
(Tensor) input tensor
dim
(int) dimension on which to split the input. Default: -1
Details
GLU(a, b) = a \otimes \sigma(b)
where input is split in half along dim to form a and b, \sigma
is the sigmoid function and \otimes is the element-wise product
between matrices.
torch documentation built on May 29, 2024, 9:54 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
View source: R/nnf-activation.R
| nnf_glu | R Documentation |
Glu
Description
The gated linear unit. Computes:
Usage
nnf_glu(input, dim = -1)
Arguments
input |
(Tensor) input tensor |
dim |
(int) dimension on which to split the input. Default: -1 |
Details
GLU(a, b) = a \otimes \sigma(b)
where input is split in half along dim to form a and b, \sigma
is the sigmoid function and \otimes is the element-wise product
between matrices.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.