| momentum | R Documentation |
Momentum SGD optimization
momentum(stepsize = 0.05, beta1 = 0.9, beta2 = 1 - beta1)
stepsize |
stepsize for SGD |
beta1 |
beta1 for momentum |
beta2 |
beta2 for momentum |
The update rule for momentum is:
v_t = \beta_1 v_{t-1} + \beta_2 g_t
x_{t+1} = x_t - \text{stepsize} * v_t
a list of control variables for optimization
(used in control_opt function)
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.