XGEN releases DAO and JING: a generative world simulation framework
Generative World Simulation with DAO and JING
The XGEN team proposes a generative world simulation framework that combines the computable world engine DAO with the first-person interactive experience model JING to enable continuous human-machine interaction. DAO maintains character, object, and spatial states and their relationships, advances according to interaction rules and world time while preserving the consequences of past actions, and then derives observer-specific conditions for JING to generate the corresponding audiovisual experience. Users can explore the environment, manipulate objects, and converse with characters through viewpoint control and text instructions, and their actions simultaneously change the shared world state and subsequent experiences.
Open original arxiv.org