activation_hard_silu: Hard SiLU activation function, also known as Hard Swish.

activation_hard_siluR Documentation

Hard SiLU activation function, also known as Hard Swish.

Description

It is defined as:

  • 0 if ⁠if x < -3⁠

  • x if x > 3

  • x * (x + 3) / 6 if ⁠-3 <= x <= 3⁠

It's a faster, piecewise linear approximation of the silu activation.

Usage

activation_hard_silu(x)

activation_hard_swish(x)

Arguments

x

Input tensor.

Value

A tensor, the result from applying the activation to the input tensor x.

Reference


rstudio/keras documentation built on April 27, 2024, 10:11 p.m.