Nous Research Proves Tokenizer-Free LLMs Are Possible
Tencent open-sources its Hy-MT2 translation models, with a compact 440MB version that can run offline on phones. The models support 33 languages and 5 Chinese dialects, and the Hy Translate app is now available.