$ ./guess_the_language
AI & ML
AI & ML · easy · #36
In NLP, what is tokenization?
Splitting text into units
Encrypting text before use
Translating text to English
Compressing text with gzip
Tokenizers break text into words, subwords or characters that map to vocabulary ids.
Play AI & ML ▸
◂ #35
all AI & ML questions
#37 ▸