skip to content
promptdojo
_
[ save your spot ]
[ follow on x ]
Tokenizers and context budget — step 3 of 7
ch 44 · cnns, transformers, and useful llm internals
3/7
promptdojo
_
›
phase 08 · ai/ml engineering
›
ch 44 · cnns, transformers, and useful llm internals
lesson 2 of 5 · tokenizers and context budget
step 3 of 7 in this lesson
Read the editor. Using the word-split stand-in, how many tokens is this text?
your prediction
Check prediction
Or run the code →
Show hint 1
ch 44 · cnns, transformers, and useful llm internals
3/7
promptdojo
_
›
phase 08 · ai/ml engineering
›
ch 44 · cnns, transformers, and useful llm internals
lesson 2 of 5 · tokenizers and context budget
step 3 of 7 in this lesson
Read the editor. Using the word-split stand-in, how many tokens is this text?
your prediction
Check prediction
Or run the code →
Show hint 1
park a thought