Venue: CoRL 2025 (Oral) · Author: Physical Intelligence · arXiv: 2504.16054 Category: VLA Architecture (Baseline) Trend tag: Hierarchy wins in the open world

flowchart LR
  V[Vision] --> VLM[VLM Backbone<br/>web-pretrained]
  L[Task: 'clean the kitchen'] --> VLM
  VLM --> HL[High-level<br/>subtask predictor<br/>'open the drawer']
  VLM --> AE[Flow-Matching<br/>Action Expert<br/>continuous chunks]
  HL --> AE
  noise --> AE
  subgraph Co-training sources
    WD[Web VQA + captions]
    DET[Object detection]
    SUB[Subtask semantic prediction]
    TELE[Multi-robot teleop]
  end
  WD & DET & SUB & TELE -. mixed batches .-> VLM

π0 was a cross-embodiment flow-matching VLA that worked on in-distribution tasks. But dropping it into an entirely new home — cleaning an unfamiliar kitchen or bedroom — broke generalization: the model couldn't parse novel scene layouts and couldn't decompose long-horizon housework into executable subtasks.

Two additions on top of π0:

1. Hierarchical split. A high-level head predicts the next semantic subtask (ℓ̂, e.g., "open the fridge door") via autoregressive token decoding; a low-level ~300M-param flow-matching expert generates continuous action chunks (50-step / 1-second) conditioned on both the overall task ℓ and the subtask ℓ̂.
2. Heterogeneous co-training. Mixed batches include multi-robot teleop + web VQA/captions + object-detection tasks + subtask-prediction tasks. Pretraining happens with FAST action tokens (discrete, for gradient stability), then flow-matching for the action expert.

Data scale: ~400 hrs mobile-manipulator data × ~100 homes, plus cross-embodiment lab data and OXE; 97.6% of pretraining examples are from non-MM sources.

First end-to-end learning-enabled system to do long-horizon, dexterous manipulation in entirely unseen homes — cleaning kitchens, tidying bedrooms. In out-of-distribution homes π0.5 reaches ~94% task success and ~94% language-following, approaching baselines trained directly on the test environments, with quantitatively significant jumps over π0 on open-world generalization suites; task-specific post-training still often needed for polish (relaxed later by π0.6 and π0.7).

π0.5 is the ancestor of the entire current π series. Every subsequent release builds on it:

• π0.6 upgrades backbone to Gemma3-4B + Knowledge Insulation.
• π*0.6 + RECAP adds advantage-conditioned RL for flow-matching.
• π0.7 adds MEM video history, subgoal-image world-model conditioning, and metadata prompting.

See π series evolution for the full side-by-side. π0.5 also establishes the "hierarchical generalist" template that OneTwoVLA, Long-VLA, and ICLR 2026's reasoning-augmented VLAs follow.

• arXiv: https://arxiv.org/abs/2504.16054
• Project PDF: https://www.pi.website/download/pi05.pdf
• Blog: https://www.pi.website/blog/pi05
• OpenPi: https://github.com/Physical-Intelligence/openpi

• π series evolution
• π0.6 · π0.7 · π*0.6 + RECAP
• Survey (CoRL 2025)

← Back to CoRL-2025