Gradient descent by hand (step 4/7) · training loops, backprop, optimizers, and schedulers

A descent step scales the gradient by the learning rate before subtracting. Fill the blank with the operator that scales grad by lr.

Operator:

A descent step scales the gradient by the learning rate before subtracting. Fill the blank with the operator that scales grad by lr.

Operator:

Gradient descent by hand — step 4 of 7