nnf_selu: Selu

In torch: Tensors and Neural Networks with 'GPU' Acceleration

Selu

Description

Applies element-wise,

SELU(x) = scale * (max(0,x) + min(0, \alpha * (exp(x) - 1)))

, with \alpha=1.6732632423543772848170429916717 and scale=1.0507009873554804934193349852946.

Usage

nnf_selu(input, inplace = FALSE)

nnf_selu_(input)

Arguments

input	(N,*) tensor, where * means, any number of additional dimensions
inplace	can optionally do the operation in-place. Default: FALSE

Examples

if (torch_is_installed()) {
x <- torch_randn(2, 2)
y <- nnf_selu(x)
nnf_selu_(x)
torch_equal(x, y)
}

torch documentation built on May 29, 2024, 9:54 a.m.