skip to content
promptdojo
_
[ save your spot ]
[ follow on x ]
Loss, forward, backward, step — step 2 of 7
ch 43 · training loops, backprop, optimizers, and schedulers
2/7
promptdojo
_
›
phase 06 · ml systems
›
ch 43 · training loops, backprop, optimizers, and schedulers
lesson 1 of 5 · loss, forward, backward, step
step 2 of 7 in this lesson
Which is the correct order of the beats inside one iteration of a torch training loop?
1
zero_grad → forward → loss → backward → step
2
forward → loss → step → backward
3
forward → loss → backward → zero_grad → step
4
backward → forward → loss → step
check
Show hint 1
ch 43 · training loops, backprop, optimizers, and schedulers
2/7
promptdojo
_
›
phase 06 · ml systems
›
ch 43 · training loops, backprop, optimizers, and schedulers
lesson 1 of 5 · loss, forward, backward, step
step 2 of 7 in this lesson
Which is the correct order of the beats inside one iteration of a torch training loop?
1
zero_grad → forward → loss → backward → step
2
forward → loss → step → backward
3
forward → loss → backward → zero_grad → step
4
backward → forward → loss → step
check
Show hint 1
park a thought