dELU: Derivatives of the Exponential Linear Unit (ELU) Activation...

In nlmixr2/rxode2: Facilities for Simulating from ODE-Based Models

Derivatives of the Exponential Linear Unit (ELU) Activation Function

Description

Derivatives of the Exponential Linear Unit (ELU) Activation Function

Usage

dELU(x, alpha = 1)

d2ELU(x, alpha = 1)

d2aELU(x, alpha = 1)

dELUa(x, alpha = 1)

d2ELUa(x, alpha = 1)

Arguments

x	A numeric vector. All elements must be finite and non-missing.
alpha	A numeric scalar. All elements must be finite and non-missing.

Value

A numeric vector where the derivative(s) of the ELU function has been applied to each element of x.

Author(s)

Matthew L. Fidler

See Also

Other Activation Functions: ELU(), GELU(), PReLU(), ReLU(), SELU(), Swish(), dGELU(), dPReLU(), dReLU(), dSELU(), dSwish(), dlReLU(), dsoftplus(), lReLU(), softplus()

Examples

dELU(c(-1, 0, 1, 2), 2)
d2ELU(c(-1, 0, 1, 2), 2)
d2aELU(c(-1, 0, 1, 2), 2)
dELUa(c(-1, 0, 1, 2), 2)
d2ELUa(c(-1, 0, 1, 2), 2)

# Can also be used in rxode2:
r <- rxode2({
  r1=dELU(time, 2)
  r2=d2ELU(time, 2)
  r2a=d2aELU(time, 2)
  ra=dELUa(time, 2)
  r2a=d2ELUa(time, 2)
})

e <- et(c(-1, 0, 1, 2))
rxSolve(r, e)

nlmixr2/rxode2 documentation built on Jan. 11, 2025, 8:48 a.m.