ICLR 2026 TT MoWM - Heungwoo/research GitHub Wiki

TMoW — Test-time mixture of world models for embodied agents

Venue: ICLR 2026 · Authors: Jinwoo Jang, Minjong Yoo, Sihyung Yoon, Honguk Woo (Sungkyunkwan University) · arXiv: 2601.22647 · Category: World model for actions · Trend tag: test-time-adaptive world models.

Approach diagram

flowchart LR
  Obs[Unseen-domain<br/>observation features] --> Route[Multi-granular<br/>prototype routing<br/>object to scene level]
  Route --> Refine[Test-time refinement<br/>align features to prototypes]
  Refine --> Mix[Mixture over<br/>world models / experts]
  Mix --> Aug[Distilled mixture<br/>augmentation<br/>build new models few-shot]
  Aug --> Pred[World-model prediction<br/>for reasoning / planning]
  Pred --> Act[Embodied action]
Loading

Problem

Language-model-based embodied agents need accurate, flexible world models to reason and act in dynamic environments. Conventional Mixture-of-Experts (MoE) routing is fixed once deployed, so it generalizes poorly to unseen domains.

Method

TMoW (Test-time Mixture of World Models) extends MoE so the routing function over world models is updated at test time, letting agents recombine existing models and integrate new ones for continual adaptation. Three mechanisms:

  • Multi-granular prototype-based routing — adapts mixtures across object-level to scene-level similarities.
  • Test-time refinement — aligns unseen-domain features with prototypes during inference.
  • Distilled mixture-based augmentation — efficiently constructs new models from few-shot data and existing prototypes.

Results

  • Evaluated on VirtualHome, ALFWorld, and RLBench.
  • Reports strong performance in both zero-shot adaptation and few-shot expansion scenarios. (Paper does not surface headline numeric scores in the abstract; specific figures omitted here pending the results tables.)

Significance

Reframes world-model selection as a test-time-adaptive routing problem rather than a frozen mixture, enabling embodied agents to continually adapt and absorb new world models in changing environments — a notable step in making world-model-driven reasoning robust to domain shift.

Links

Related pages

← Back to ICLR-2026

⚠️ **GitHub.com Fallback** ⚠️