activation_mish: Mish

Description Usage Arguments Details Value

View source: R/activations.R

Description

Mish: A Self Regularized Non-Monotonic Neural Activation Function.

Usage

1

Arguments

x

A 'Tensor'. Must be one of the following types: 'float16', 'float32', 'float64'. Returns: A 'Tensor'. Has the same type as 'x'.

Details

Computes mish activation: x * tanh(softplus(x)) See [Mish: A Self Regularized Non-Monotonic Neural Activation Function](https://arxiv.org/abs/1908.08681).

Value

A 'Tensor'. Has the same type as 'x'.


tfaddons documentation built on July 2, 2020, 2:12 a.m.