Code Plans, Diffusion Renders: Open-Ended Generative World Modeling

Zixun Fang1,2 Yawen Shao1,2 Kai Zhu2 Jie Xiao2 Shihan Chen1 Yu Liu2

Xueyang Fu1 Yang Cao1 Wei Zhai1 Zheng-Jun Zha1

1 USTC 2 TongYi Lab

A LOOK INSIDE

Method Overview

CoDeR method diagram: concepts guide an LLM creator; coding agents construct the world, video models act as artists, and travelers observe it. The right panel shows observation and world registration.
Overview of CoDeR.

Method Overview

PDF
Enlarged CoDeR method diagram