PReLU: Parametric ReLU Activation Function

View source: R/prelu.R

PReLUR Documentation

Parametric ReLU Activation Function

Description

Parametric ReLU Activation Function

Usage

PReLU(x, alpha = 1)

Arguments

x

A numeric vector. All elements must be finite and non-missing.

alpha

A numeric scalar. All elements must be finite and non-missing.

Value

A numeric vector where the ReLU function has been applied to each element of x.

Author(s)

Matthew Fidler

See Also

Other Activation Functions: ELU(), GELU(), ReLU(), SELU(), Swish(), dELU(), dGELU(), dPReLU(), dReLU(), dSELU(), dSwish(), dlReLU(), dsoftplus(), lReLU(), softplus()

Examples


PReLU(c(-1, 0, 1, 2), 2)

# Can also be used in rxode2:
x <- rxode2({
   r=PReLU(time, 2)
})

e <- et(c(-1, 0, 1, 2))

rxSolve(x, e)


nlmixr2/rxode2 documentation built on Jan. 11, 2025, 8:48 a.m.