gelu: Gaussian Error Linear Unit
In jonathanbratt/RBERT: R Implementation of BERT
gelu R Documentation
Gaussian Error Linear Unit
Description
This is a smoother version of the RELU. Original paper:
https://arxiv.org/abs/1606.08415
Usage
gelu(x)
Arguments
x
Float Tensor to perform activation on.
Value
'x' with the GELU activation applied.
Examples
## Not run:
tfx <- tensorflow::tf$get_variable("none", tensorflow::shape(10L))
gelu(tfx)
## End(Not run)
jonathanbratt/RBERT documentation built on Jan. 26, 2023, 4:15 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| gelu | R Documentation |
Gaussian Error Linear Unit
Description
This is a smoother version of the RELU. Original paper: https://arxiv.org/abs/1606.08415
Usage
gelu(x)
Arguments
x |
Float Tensor to perform activation on. |
Value
'x' with the GELU activation applied.
Examples
## Not run:
tfx <- tensorflow::tf$get_variable("none", tensorflow::shape(10L))
gelu(tfx)
## End(Not run)
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.