zoneout: zoneout

Description Usage Arguments Value

Description

Applies zoneout as described in Krueger et al. 2017

Usage

1
zoneout(thisState, prevState, p)

Arguments

thisState

the current state (mx.symbol)

prevState

the state from the previous sequence (mx.symbol).

p

zoneout probability in (0;1]. Rounded to 6 digits

Value

During training: out(t) = x(t) * thisState(t) + (1 - x(t)) * prevState(t). x(t) is a 0/1 mask for each element t with the probability p of being 0. During application: out(t) = (1 - p) * thisState(t) + p * prevState(t)


MarkusBonsch/mxLSTM documentation built on May 28, 2019, 6:40 a.m.