lamb_step: Lamb_step

Description Usage Arguments Value

View source: R/optimizers.R

Description

Step for LAMB with 'lr' on 'p'

Usage

1
lamb_step(p, lr, mom, step, sqr_mom, grad_avg, sqr_avg, eps, ...)

Arguments

p

p

lr

learning rate

mom

momentum

step

step

sqr_mom

sqr momentum

grad_avg

gradient average

sqr_avg

sqr average

eps

epsilon

...

additional arguments to pass

Value

None


fastai documentation built on Oct. 25, 2021, 5:08 p.m.