DE — heise online
Report: China trains AI by distilling US models
AI1 min read
A report says Chinese AI companies and research labs often train their models by copying answers from big US AI models. This is called distillation, and it helps them work around a shortage of computing power.
What happened
Reuters looked through more than 300 Chinese research papers, patents, company statements, job ads and government documents. It found that Chinese AI firms and research groups seem to use large US models to train their own models. The practice is moving from universities into industry, and the Chinese government supports it so that AI is cheaper for factories to use.
What is distillation?
In distillation, a strong 'teacher' AI model gives answers or step-by-step solutions. A smaller 'student' AI model learns from these answers. The method is not illegal in itself. US AI companies such as Anthropic and OpenAI say Chinese firms break their terms of use. They claim this is done with fake identities, stolen API keys and stolen credit cards. China rejects the accusations and says US companies do similar things.
Key facts
- Reuters reviewed more than 300 documents from China.
- Researchers at Shanghai Jiao Tong University picked about 5,000 answers from OpenAI's o1 model.
- They built 10,750 bilingual training examples and used them to train Alibaba's Qwen2.5-72B.
- A government plan called 'AI+Manufacturing', published in January by eight agencies, names distillation as a way to support industrial use.
Why it matters
Distillation cannot copy everything a big model can do, and it does not replace strong computer chips. But it can teach small models certain skills. US export bans leave China with few powerful AI chips, so this method helps Chinese firms get more from what they have. It also raises questions about fair use, security and how much China can build its own new ideas.
What to watch
- Whether US companies or agencies take legal or policy action against Chinese distillation.
- Whether China gives clear rules on where normal use of foreign models ends.
- Whether Chinese firms find more computing power outside China to avoid export controls.
Glossary
- Reuters
- A global news agency that reports news for newspapers, TV and websites.
- Anthropic
- A US AI company that makes the Claude AI models.
- OpenAI
- A US AI company that makes ChatGPT and the GPT models.
- Alibaba
- A large Chinese technology company that builds the Qwen AI models.