EXPLORINEER
en

CN — TechNode

Tencent releases Hy4 model weights with million-token context

AI1 min read

Tencent has released the model files (called weights) for its top AI model, Hy4. Anyone can now download, run and change it, even for business use.

What happened

On Friday, Tencent made the weights of its flagship Hy4 AI model public. Developers can download the model and run it on their own computers or servers. The model was first launched on November 4. It is now licensed under Apache 2.0, a free license that allows commercial use and changes to the model.

Key numbers and facts

  • Context window: about 1 million tokens (the amount of text the model can read at once)
  • Language backbone: 770 billion parameters (the model's internal settings)
  • Active per token: 49 billion parameters, because it is a mixture-of-experts model that uses only some experts at a time
  • Understands text, images and video
  • Tencent provides setup guides for vLLM and SGLang, plus fine-tuning resources and a safety evaluation card

Some background

Hy4 is a large AI model that can read and understand many kinds of content. A mixture-of-experts model is built from many smaller specialist parts, and only a few of them work on each word. This makes it faster to run than its full size suggests. The smaller Hy4 flash model was opened earlier, and this release comes after that.

Why it matters

Open weights let companies and students test, change and build on a strong AI model without paying Tencent for each use. The model is also good at long documents, coding tasks, games and office work. Tencent says Hy4 improves on the earlier Hy4 preview in following instructions and handling long tasks.

What to watch

  • How many developers download and deploy Hy4 in the coming weeks
  • Independent tests of how well Hy4 performs against other top AI models
  • Whether the safety tools and evaluation card prove useful in real projects

Glossary

Tencent
A large Chinese technology company that makes games, social apps and AI models.
Hy4
Tencent's flagship AI model that reads text, images and video.
weights
The saved numbers inside an AI model that let it work. Releasing them lets others run the model.
vLLM
A tool that helps run large AI language models quickly on computers.

Ad

Add 150 words. Learn 10 a day.

Dicter word books send only the words you learn to your review notes.

AITechCrunch

Is selling an AI version of your face to this microdrama startup the future of Hollywood?

Microdrama startup Shortical, founded last January, makes short two-minute romance episodes and is now producing AI-generated content. Its latest series, "Inevitable," stars Israeli actor Aki Avni, who licensed his face to the company to create a digital avatar of himself for the wholly AI-made project, which premiered in Los Angeles. Shortical says the offering is in its early days and has not yet resulted in any signed contracts beyond the Avni deal.

AITechCrunch

Here are the top AI agents that can live in your text messages

A growing number of AI agents can be texted like a normal contact, remembering context, connecting to everyday apps and services, and completing tasks such as scheduling, booking, shopping, and reminders. The article highlights Instinct, which reportedly has a $10 billion valuation after raising $1 billion, along with other options like Ask Proxy, Caddy, Comma, and Fambot, which target personal, work, and family use.

AIThe Register

ChatGPT shrunk down to run on a Super Nintendo

Tech journalist Benj Edwards has released ChatGPT for SNES, a tiny chatbot that runs in an emulator or as a ROM on a Super Nintendo cartridge. It is a 2.2 million-parameter distilled version of OpenAI's GPT-OSS-120b, with an optional fact book drawn from simple English Wikipedia, and Edwards says it knows about 8,000 words and often gets things wrong.