arXiv 2610.29989
Looking Ahead: Modeling Future Evolution in Autoregressive Video Generation
AI108 upvotes
Authors: Ruopeng Gao, Yukun Huang, Jiarui Hu, Shuai Wang, Wenbo Hu, Ying Shan, Limin Wang
Overview
The authors propose Future Chunk Prediction (FCP), an auxiliary training objective that is optimized jointly with teacher-forced denoising in autoregressive video diffusion models. FCP predicts temporally separated future chunks without access to the intervening visual context, using supervision taken directly from training videos. Autoregressive inference is left unchanged, and no extra pretrained visual encoder is needed.
Introduction
Autoregressive video diffusion models generate video chunk by chunk, but plausible-looking continuations do not ensure that the model learns how scenes evolve over time. Under teacher forcing, strong temporal redundancy may let local continuity act as a shortcut, reducing the incentive to model visual evolution.
Results
FCP achieves superior physical plausibility over standard teacher-forced autoregressive training. It does so with a lower overall training compute budget.
Conclusion
Future-chunk supervision is an effective and efficient way to model visual evolution, and the structured representations it appears to produce may help in building autoregressive world models.