nn_elu: ELU module

nn_eluR Documentation

ELU module

Description

Applies the element-wise function:

Usage

nn_elu(alpha = 1, inplace = FALSE)

Arguments

alpha

the α value for the ELU formulation. Default: 1.0

inplace

can optionally do the operation in-place. Default: FALSE

Details

\mbox{ELU}(x) = \max(0,x) + \min(0, α * (\exp(x) - 1))

Shape

  • Input: (N, *) where * means, any number of additional dimensions

  • Output: (N, *), same shape as the input

Examples

if (torch_is_installed()) {
m <- nn_elu()
input <- torch_randn(2)
output <- m(input)
}

torch documentation built on Oct. 24, 2022, 5:08 p.m.