lamb_step: Lamb_step

View source: R/optimizers.R

lamb_stepR Documentation

Lamb_step

Description

Step for LAMB with 'lr' on 'p'

Usage

lamb_step(p, lr, mom, step, sqr_mom, grad_avg, sqr_avg, eps, ...)

Arguments

p

p

lr

learning rate

mom

momentum

step

step

sqr_mom

sqr momentum

grad_avg

gradient average

sqr_avg

sqr average

eps

epsilon

...

additional arguments to pass

Value

None


fastai documentation built on June 22, 2024, 11:15 a.m.