Code Plans, Diffusion Renders: Open-Ended Generative World Modeling

Zixun Fang1,2 Yawen Shao1,2 Kai Zhu2 Jie Xiao2 Shihan Chen1 Yu Liu2

Xueyang Fu1 Yang Cao1 Wei Zhai1 Zheng-Jun Zha1

1 USTC 2 Alibaba Group

A LOOK INSIDE

Method Overview

CoDeR method diagram: concepts guide an LLM creator; coding agents construct the world, video models act as artists, and travelers observe it. The right panel shows observation and world registration.
Overview of CoDeR.

Video Comparisons

ABot-World, Matrix-Game 3.0, LingBot-World, and Ours
EgoSim and Ours
HyDRA, LiveWorld, and Ours
H3-World and Ours

Method Overview

PDF
Enlarged CoDeR method diagram