rmsprop.updater-class: rmsprop updater

Description Details Fields

Description

Another updater with adaptive step sizes, like adagrad and adadelta.

Details

https://climin.readthedocs.org/en/latest/rmsprop.html

Fields

learning.rate

the learning rate (set to one in the original paper)

squared.grad

a matrix summing the squared gradients over previous updates (decays according to gamma)

decay

how quickly should squared gradients decay?

delta

the delta matrix (see updater)


davharris/mistnet documentation built on May 14, 2019, 9:28 p.m.