CN — TechNode
Tencent releases Hy4 model weights with million-token context
AI1 min read
Tencent has released the model files (called weights) for its top AI model, Hy4. Anyone can now download, run and change it, even for business use.
What happened
On Friday, Tencent made the weights of its flagship Hy4 AI model public. Developers can download the model and run it on their own computers or servers. The model was first launched on November 4. It is now licensed under Apache 2.0, a free license that allows commercial use and changes to the model.
Key numbers and facts
- Context window: about 1 million tokens (the amount of text the model can read at once)
- Language backbone: 770 billion parameters (the model's internal settings)
- Active per token: 49 billion parameters, because it is a mixture-of-experts model that uses only some experts at a time
- Understands text, images and video
- Tencent provides setup guides for vLLM and SGLang, plus fine-tuning resources and a safety evaluation card
Some background
Hy4 is a large AI model that can read and understand many kinds of content. A mixture-of-experts model is built from many smaller specialist parts, and only a few of them work on each word. This makes it faster to run than its full size suggests. The smaller Hy4 flash model was opened earlier, and this release comes after that.
Why it matters
Open weights let companies and students test, change and build on a strong AI model without paying Tencent for each use. The model is also good at long documents, coding tasks, games and office work. Tencent says Hy4 improves on the earlier Hy4 preview in following instructions and handling long tasks.
What to watch
- How many developers download and deploy Hy4 in the coming weeks
- Independent tests of how well Hy4 performs against other top AI models
- Whether the safety tools and evaluation card prove useful in real projects
Glossary
- Tencent
- A large Chinese technology company that makes games, social apps and AI models.
- Hy4
- Tencent's flagship AI model that reads text, images and video.
- weights
- The saved numbers inside an AI model that let it work. Releasing them lets others run the model.
- vLLM
- A tool that helps run large AI language models quickly on computers.