lamb_step {fastai}

Lamb_step

Description

Step for LAMB with 'lr' on 'p'

Usage

lamb_step(p, lr, mom, step, sqr_mom, grad_avg, sqr_avg, eps, ...)

Arguments

p

p

lr

learning rate

mom

momentum

step

step

sqr_mom

sqr momentum

grad_avg

gradient average

sqr_avg

sqr average

eps

epsilon

...

additional arguments to pass

Value

None