skip to content
promptdojo
_
[ save your spot ]
[ follow on x ]
Attention and Transformer blocks — step 3 of 7
ch 44 · cnns, transformers, and useful llm internals
3/7
promptdojo
_
›
phase 06 · ml systems
›
ch 44 · cnns, transformers, and useful llm internals
lesson 3 of 5 · attention and transformer blocks
step 3 of 7 in this lesson
Softmax turns scores into attention weights. What does this print for three score gaps?
your prediction
Check prediction
Or run the code →
Show hint 1
ch 44 · cnns, transformers, and useful llm internals
3/7
promptdojo
_
›
phase 06 · ml systems
›
ch 44 · cnns, transformers, and useful llm internals
lesson 3 of 5 · attention and transformer blocks
step 3 of 7 in this lesson
Softmax turns scores into attention weights. What does this print for three score gaps?
your prediction
Check prediction
Or run the code →
Show hint 1
park a thought