Complete the greedy tokenizer: longest candidate first, vocabulary membership, and advancing past the matched piece.