World models
Technique · World Models & Robotics · 9 items since Apr 2026
Models that predict how an environment responds to actions, used to simulate, plan, or train.
Related
- Techniques
Trends
Items
- Oct 2
KAIST's World Observer
A world model that decouples observing from acting by jointly generating an agent-centric view alongside panoramic observers, so objects that leave the actor's view keep evolving and re-enter with correct state, substantially improving out-of-view dynamics.
- Sep 25
WROP teaches world models object permanence
Introduces WROP, a cognitive-science-inspired benchmark and 1.5M-sample corpus for object permanence, and trains a 16B video world model (PWM-WROP) that ranks first among continuation models in a blind pairwise Elo study.
- Sep 18
JEPA-Anything extends world models across seven domains
A domain-agnostic world-modeling framework extends joint-embedding predictive architectures with orthogonal predictive factorization, generalizing across seven domains including clinical trajectories and molecular dynamics, with a factor-nominated biological intervention validated in organoids and mice.
- Sep 4
ACE Robotics' Puffin-World
A unified multimodal model represents physics (gravity field, latitude), depth, and appearance under an Omni-Camera formulation to generate, reconstruct, and explore physically consistent 3D worlds in a closed loop, trained on the released 15M-triplet Puffin-16M dataset.
- Aug 8
Alibaba's DreamX-Phi 1.0 manipulation world model
An action-conditioned video world model that injects per-arm SE(3) transforms through geometric attention, plus a depth branch and object masks, to predict faithful manipulation rollouts, taking first place on Track 1 of the WorldArena 2.0 Challenge.
- Aug 1
EnvACE trains agents through world rehearsal
Replaces costly executable training environments with a single policy that alternates between acting and simulating the environment's response, internalizing an agent world model and beating environment-scaling baselines on BFCL-v4, tau2-Bench, VitaBench, and FinMCP-Bench.
- Jul 17
Interactive world models rethought as game engines
The paper reframes interactive world models around a game engine's action-state-observation loop and releases a Black Myth: Wukong data engine with 90+ hours of frame-aligned gameplay, player actions, and ground-truth game states.
- Jun 23
Alibaba's Qwen-AgentWorld world models
The first open-weight language world models (35B-A3B and 397B-A17B) simulate agentic environments across seven domains via long chain-of-thought, serving as decoupled simulators that improve agentic RL beyond real-environment training, released with the AgentWorldBench evaluation.
- Apr 24
A levels-and-laws taxonomy of agentic world models
A survey of 400+ works sorts world models into three capability levels (one-step predictor, multi-step simulator, self-revising evolver) across physical, digital, social, and scientific regimes, and proposes decision-centric evaluation with a minimal reproducible package.