dictionary · English Wiktionary
detokenize
Pronunciation D EH1 T AH0 N AY0 Z1 definition(s) across 1 part(s) of speech · fetched 2026-11-19
Verb1 sense
To convert (a tokenized representation) back to the original form.
dictionary · English Wiktionary
Pronunciation D EH1 T AH0 N AY0 Z1 definition(s) across 1 part(s) of speech · fetched 2026-11-19
To convert (a tokenized representation) back to the original form.