dictionary · English Wiktionary
detokenizer
Pronunciation T OW1 K AH0 N AY0 Z ER01 definition(s) across 1 part(s) of speech · fetched 2026-10-26
Noun1 sense
A program or algorithm that detokenizes.
dictionary · English Wiktionary
Pronunciation T OW1 K AH0 N AY0 Z ER01 definition(s) across 1 part(s) of speech · fetched 2026-10-26
A program or algorithm that detokenizes.