leaky.relu: A "leaky" RELU function, and derivative. The slope in the...

View source: R/activations-losses.R View source: R/.ipynb_checkpoints/activations-losses-checkpoint.R

leaky.reluR Documentation

A "leaky" RELU function, and derivative. The slope in the negative region is 0.1.

Description

A "leaky" RELU function, and derivative. The slope in the negative region is 0.1.

Usage

leaky.relu(X, deriv = FALSE)

Arguments

X

A matrix.

deriv

Set this to TRUE if you want the derivative instead of the function.

Value

A matrix representing the leaky RELU(X), or its derivative.


Greg-Hallenbeck/easy.mlp documentation built on March 10, 2023, 6:31 a.m.