𝐒𝐢𝐦𝐚𝐧𝐭𝐨 । 𝐀𝐈 𝐍𝐞𝐰𝐬 𝐇𝐮𝐛

How do you grade a world model? Against what the robot really did. Picture a robot gripper closing on a piece of fruit. In the real world, it fails to grasp it. Now hand the same first frame and the same action sequence to an action-conditioned world model (ACWM). The rollout shows a tidy, successful pick. Nothing on screen looks wrong. That is the moment @WOB_WorldOracle was built for. Created by AGIBOT and NVIDIA together with Princeton, UT Austin and the University of Toronto, it is an evaluation platform for robot behavior models. It replays the real, recorded actions through a model and checks the predicted future against the paired real execution. The stakes are practical. The paper points to data generation, scalable policy evaluation and closed-loop policy learning as potential uses of ACWMs. If a model gets the physical consequences wrong, everything built on top of it inherits the error. The authors call the property they are testing execution coherence: does the model follow the actions it is given, even the bad ones, across different embodiments and action sources, and over long rollouts? What makes the setup unusual is where the evidence comes from. The paper compares eight existing embodied world-model benchmarks, and none of them combines action-conditioned evaluation, real-world data, failed executions, long episodes, multiple embodiments, multi-view outputs and policy-generated actions. @WOB_WorldOracle does. Its evaluation set has 335 episodes: 100 on AGIBOT G2, 75 on YAM and 100 with a human hand, all human-operated, plus 60 rollouts where a learned policy drove a real AGIBOT G2 robot. About 40% of the human-operated segments are failures, so a model cannot get by on success stories.