nnf_hardswish: Hardswish

View source: R/nnf-activation.R View source: R/nnf-activation.R

nnf_hardswishR Documentation

Hardswish

Description

Applies the hardswish function, element-wise, as described in the paper: Searching for MobileNetV3.

Usage

nnf_hardswish(input, inplace = FALSE)

Arguments

input

(N,*) tensor, where * means, any number of additional dimensions

inplace

can optionally do the operation in-place. Default: FALSE

Details

\mbox{Hardswish}(x) = \left\{ \begin{array}{ll} 0 & \mbox{if } x \le -3, \\ x & \mbox{if } x \ge +3, \\ x \cdot (x + 3)/6 & \mbox{otherwise} \end{array} \right.


torch documentation built on May 29, 2024, 9:54 a.m.