nn_relu: ReLU module

In torch: Tensors and Neural Networks with 'GPU' Acceleration

ReLU module

Description

Applies the rectified linear unit function element-wise

\mbox{ReLU}(x) = (x)^+ = \max(0, x)

Usage

nn_relu(inplace = FALSE)

Arguments

inplace

can optionally do the operation in-place. Default: FALSE

Shape

• Input: (N, *) where * means, any number of additional dimensions

• Output: (N, *), same shape as the input

Examples

if (torch_is_installed()) {
m <- nn_relu()
input <- torch_randn(2)
m(input)
}

torch documentation built on May 29, 2024, 9:54 a.m.