Archive — CN — technode
ByteDance reorganizes Seed foundation-model team amid reported 5trillion-parameter model plans
ByteDance's Seed foundation-model division has undergone restructuring, establishing four new departments focused on pre-training, RL, product applications, and dialogue models. This move aligns with reports on a potential 5 trillion-parameter model in the works, though details are still tentative and unconfirmed as a product.
Key points
- ByteDance's Seed division has restructured into four departments: Pretrain Data, Horizon RL, Product Posttrain-Work, and Product Posttrain-Chat.
- The Work team will develop business applications for products like Doubao and Dola.
- The Chat team will focus on consumer dialogue models.
- This restructuring is connected to plans for a new model boasting over 5 trillion parameters, but no official product announcement has been made.
Why it matters
- The rise of foundation models is significant in AI development, illustrated by trends such as increasing model sizes and capabilities.
- Many tech companies are investing in large-scale language models as part of their strategy to drive innovation and gain competitive advantage.
The reorganization of ByteDance's foundation-model team underlines the company's commitment to advancing AI capabilities, positioning it strategically within the rapidly evolving tech landscape focused on large-scale models.