@ew-pawn said in #20:
> i had an old account xD i know maths sirr
You know better maths than all of us.
w -= lr * ((b1*m + (1-b1)*g) / sqrt(b2*v + (1-b2)*g^2 + e))
I too know some maths, not a genius though.
For anyone wondering it represents the update rule of Adam optimizer.
my thoughs exactly
This topic has been archived and can no longer be replied to.