nnf_leaky_relu: Leaky_relu

In torch: Tensors and Neural Networks with 'GPU' Acceleration

Leaky_relu

Description

Applies element-wise, LeakyReLU(x) = max(0, x) + negative_slope * min(0, x)

Usage

nnf_leaky_relu(input, negative_slope = 0.01, inplace = FALSE)

Arguments

input	(N,*) tensor, where * means, any number of additional dimensions
negative_slope	Controls the angle of the negative slope. Default: 1e-2
inplace	can optionally do the operation in-place. Default: FALSE

torch documentation built on May 29, 2024, 9:54 a.m.