nnf_gelu: Gelu

Description Usage Arguments gelu(input) -> Tensor

View source: R/nnf-activation.R

Description

Gelu

Usage

1
nnf_gelu(input)

Arguments

input

(N,*) tensor, where * means, any number of additional dimensions

gelu(input) -> Tensor

Applies element-wise the function GELU(x) = x * Φ(x)

where Φ(x) is the Cumulative Distribution Function for Gaussian Distribution.

See Gaussian Error Linear Units (GELUs).


torch documentation built on Oct. 7, 2021, 9:22 a.m.