Swish: Switch Activation Function

In nlmixr2/rxode2: Facilities for Simulating from ODE-Based Models

Switch Activation Function

Description

The switch activation function is defined as:

Usage

Swish(x)

Arguments

x	A numeric vector. All elements must be finite and non-missing.

Details

f(x) = x \cdot \text{sigmoid}(x)

Value

A numeric vector where the ReLU function has been applied to each element of x.

Author(s)

Matthew Fidler

See Also

Other Activation Functions: ELU(), GELU(), PReLU(), ReLU(), SELU(), dELU(), dGELU(), dPReLU(), dReLU(), dSELU(), dSwish(), dlReLU(), dsoftplus(), lReLU(), softplus()

Examples

Swish(c(-1, 0, 1, 2))

# Can also be used in rxode2:
x <- rxode2({
   r<- Swish(time)
})

e <- et(c(-1, 0, 1, 2))

rxSolve(x, e)

nlmixr2/rxode2 documentation built on Jan. 11, 2025, 8:48 a.m.