Pinned Tweet
Animals can’t learn by being tele-operated. But, they do learn by observing and interacting with the world around them. So, why don’t robots learn this way?
Excited to release, “Planning from Observation and Interaction”, for real-world observational learning on robots! 🧵(1/12)
報酬もシミュレータもテレオペもない場所で学ぶロボット
観察だけで逆強化学習を回すMPAIL2
実機の上でゼロからというのが肝
報酬設計の手間が消えると展開の速さが変わる
現場のデータで育つロボットが増える
CoRL2026の発表
How will robots learn in deployment, where hand-designed rewards, simulators, and tele-operators are nowhere to be found?
At #CoRL2026 presenting MPAIL2, the first demonstration of on-robot Inverse Reinforcement Learning from scratch towards robots that learn from observation and interaction!
🧵 More below
Tyler Han retweeted
Check out our project on enabling real world robot learning using the principles of IRL along with some model based magic!
How will robots learn in deployment, where hand-designed rewards, simulators, and tele-operators are nowhere to be found?
At #CoRL2026 presenting MPAIL2, the first demonstration of on-robot Inverse Reinforcement Learning from scratch towards robots that learn from observation and interaction!
🧵 More below
How will robots learn in deployment, where hand-designed rewards, simulators, and tele-operators are nowhere to be found?
At #CoRL2026 presenting MPAIL2, the first demonstration of on-robot Inverse Reinforcement Learning from scratch towards robots that learn from observation and interaction!
🧵 More below
A takeaway: policy improvement itself may not need to be stabilized. Instead, actors can stably improve through interaction by planning over faster, more robust verifiers.
1
23
Website: uwrobotlearning.github.io/mp…
Paper: arxiv.org/abs/2602.24121
Code: github.com/UWRobotLearning/m…
Come find us at #CoRL2026 : Wednesday 11/11 from 10:30 - 12:00 at Poster #32. With @bxtbold, Siyang Shen, @RohanBaijal, Richard Ebock, @harine_ravi, @kevin_huang8, Sanghun Jung, and Byron Boots.
1
56
Tyler Han retweeted
Excited to share the first paper of my undergrad, Q-OIL, which we’ll be presenting at #CoRL2026 in Austin!
Interventions provide a natural source of feedback for robots to learn from in the real world. But, humans intervene suboptimally, which needs to be accounted for in both simulation benchmarking and algorithms.
We analyze human intervention data and measure intervention suboptimality in both timing and execution. Thus, rather than using interventions as supervision, we use them as soft exploration guidance.
(1/8)
Tyler Han retweeted
Want to turn any VLM into a better reward model for robotics? (yes, even Astra)
Introducing D&A: decoupling description and assessment improves any VLM family for zero-shot robot rewards.
D&A scales with improvements across GPT, Gemini, Claude, Qwen, ...
It enables zero-shot RL and filtered IL, improves code-as-policies via rich language feedback, and achieves SOTA on three benchmarks.
Website: weirdlabuw.github.io/dna
Tyler Han retweeted
Multi-arm robots can do more together, but teaching them to coordinate carefully is hard.
Introducing ScheduleGen, an automated data gen system for multi-arm manipulation.
We evaluate it in 28 sim and 8 real-world tasks including real2sim2real.
njawale42.github.io/Schedule…
Another drop from my dream team for Sim2Real
(1/5) Everyone says dexterous manipulation needs real-world data. These policies were trained with none. Our robots mesh gears, thread nuts, and insert pegs zero-shot from RGB, and the same recipe works for locomotion across terrains much harder than before.
The missing piece wasn't a better RL algorithm, but a small tweak to what the robot practices.
Today we're releasing Success-Guided Sampling (SGS), a simple change to the task sampler that unlocks new levels of dexterity and agility with large-scale, end-to-end sim2real RL.
No demonstrations, no per-task reward tuning. Just PPO at scale.
Check out the policies yourself at sgs-rl.github.io! All videos at 1x speed! 🧵 🔈
Tyler Han retweeted
Proud to have been part of the team that just released Rho, the latest open-weight Vision-Language-Action (VLA) model! Check out the code, model weights, and tech report for more details and to see how to use it on your own robot 🤖
🚀Stoked to announce the release of Rho, a family of open-weights 5B VLAs underlying @MSFTResearch work on Rho-alpha VLA+ (microsoft.com/en-us/research…)
🤖 Project page: microsoft.github.io/rhobotic…
📰 Tech report: arxiv.org/abs/2609.38164
⌨️ Code: github.com/microsoft/rhoboti…
🤗 Models and data: huggingface.co/collections/m…
Rho is a step in the direction of physical AI adept at adapting to new tasks and environments, motivated by a simple observation: offline supervised finetuning (SFT), the physical AI task adaptation stage "owned" by robot operators, is too data-hungry, because it tries to do too much besides learning the task per se: (1) mastering the control of the robot doing the task, and (2) exposing the model to many target task and environment variations.
To address hurdle (1), we publish Rho checkpoints midtrained for @i2rt_robotics YAM Box, @Universal_Robot AI Trainer, and @FRANKAROBOTICS FR3 Duo, representative dual-arm robot setups across research labs and the industry. Rho itself is built on @Microsoft's own special Phi-series backbone and pretrained on robot data in the end-effector space, including UMI-style and @NVIDIARobotics Isaac Sim demonstrations, to facilitate its midtraining for other robots. Embodiment-midtrained Rho outperforms the strongest existing open-weights VLAs on physical robots and in simulation.
And then there is hurdle (2), complicated by the tendency of offline data collection to oversample the same task situations while under-sampling those where the robot's policy actually needs help. We mitigate this by pairing with Rho with online adaptation methods, particularly FlowDAgger (microsoft.github.io/FlowDAgg…, a 🏅Spotlight🏅 at #CoRL2026), which kick in after offline SFT and use online corrections for model improvement, resulting in much more data-efficient task adaptation end-to-end.
VAMs and WAMs, new zero-shot capabilities of physical AI, tactile sensing data, tactile-sensing humanoid hands, GPT-6 -- all of these hold the potential for making Rho and its successors so much more effective than we imagined just a year ago. Come to the 🤖8th Robot Learning Workshop at #NeurIPS2026 🤖 (robot-learning.ml/2026/) to geek out about these topics, and try Rho on your robots!
🙌 Congratulations to the team that has made Rho happen -- Simran Bagaria, Daphne Chen, Dean Fortier, Jianlong Fu, Michael Harrison, @TessHelleb88231, @neelsj, Dalton Moore, Galen Mullins, Michael Murray, Eduardo Salinas, and Reuben Tan! A huge shout-out to TPMs @Vivan_Amin and Ade Famoti, to @Universal_Robot for partnering with us, and to @ashleyllorens for his sponsorship and guidance in this work. Coming together from across @MSFTResearch's multiple organizations and locations in Redmond, Phoenix, New York, and Beijing, this team built more than a VLA family; it has laid a major foundation stone for @Microsoft's physical AI efforts. Truly impressive and inspiring. 🚀
#PhysicalAI #Robotics #MicrosoftResearch
Tyler Han retweeted
A nice statement from the mathematicians: mathandai.org
This captures what robotics means to me and what will always be missing from big companies: the essence of a "Garage Robot".
One day, only real-world RL will separate some scrap metal, motors, sensors, and a processor from a robot. Til then, hobbyists are stuck designing sims.
Sharing some fun experiments with Microduck
Basically, once you have an open-source robot with so many sensors, the sky's the limit
Here we vibe-coded an image detector integration to detect and follow a laser pointer.
More at pollen-robotics.com/microduc…
42
5,794
At RLC/Montreal this weekend! Would love to meetup with anyone interested in robot learning and real-world Inverse RL or down to explore the area together!
Tyler Han retweeted
VLAs can do a lot zero-shot. But when one fails, there's no way to tell it what went wrong - you collect more demos and retrain.
What if you could just say something?
Introducing ARCHITECT 🤖👷: a robot coding agent that synthesizes policies from free-form language instructions.
robo-architect.github.io/
🧵1/N











