報酬もシミュレータもテレオペもない場所で学ぶロボット
観察だけで逆強化学習を回すMPAIL2
実機の上でゼロからというのが肝
報酬設計の手間が消えると展開の速さが変わる
現場のデータで育つロボットが増える
CoRL2026の発表
How will robots learn in deployment, where hand-designed rewards, simulators, and tele-operators are nowhere to be found?
At #CoRL2026 presenting MPAIL2, the first demonstration of on-robot Inverse Reinforcement Learning from scratch towards robots that learn from observation and interaction!
🧵 More below
Tyler Han retweeted
Check out our project on enabling real world robot learning using the principles of IRL along with some model based magic!
How will robots learn in deployment, where hand-designed rewards, simulators, and tele-operators are nowhere to be found?
At #CoRL2026 presenting MPAIL2, the first demonstration of on-robot Inverse Reinforcement Learning from scratch towards robots that learn from observation and interaction!
🧵 More below
Tyler Han retweeted
Excited to share the first paper of my undergrad, Q-OIL, which we’ll be presenting at #CoRL2026 in Austin!
Interventions provide a natural source of feedback for robots to learn from in the real world. But, humans intervene suboptimally, which needs to be accounted for in both simulation benchmarking and algorithms.
We analyze human intervention data and measure intervention suboptimality in both timing and execution. Thus, rather than using interventions as supervision, we use them as soft exploration guidance.
(1/8)
Tyler Han retweeted
Want to turn any VLM into a better reward model for robotics? (yes, even Astra)
Introducing D&A: decoupling description and assessment improves any VLM family for zero-shot robot rewards.
D&A scales with improvements across GPT, Gemini, Claude, Qwen, ...
It enables zero-shot RL and filtered IL, improves code-as-policies via rich language feedback, and achieves SOTA on three benchmarks.
Website: weirdlabuw.github.io/dna
Tyler Han retweeted
Multi-arm robots can do more together, but teaching them to coordinate carefully is hard.
Introducing ScheduleGen, an automated data gen system for multi-arm manipulation.
We evaluate it in 28 sim and 8 real-world tasks including real2sim2real.
njawale42.github.io/Schedule…
Tyler Han retweeted
Proud to have been part of the team that just released Rho, the latest open-weight Vision-Language-Action (VLA) model! Check out the code, model weights, and tech report for more details and to see how to use it on your own robot 🤖
🚀Stoked to announce the release of Rho, a family of open-weights 5B VLAs underlying @MSFTResearch work on Rho-alpha VLA+ (microsoft.com/en-us/research…)
🤖 Project page: microsoft.github.io/rhobotic…
📰 Tech report: arxiv.org/abs/2609.38164
⌨️ Code: github.com/microsoft/rhoboti…
🤗 Models and data: huggingface.co/collections/m…
Rho is a step in the direction of physical AI adept at adapting to new tasks and environments, motivated by a simple observation: offline supervised finetuning (SFT), the physical AI task adaptation stage "owned" by robot operators, is too data-hungry, because it tries to do too much besides learning the task per se: (1) mastering the control of the robot doing the task, and (2) exposing the model to many target task and environment variations.
To address hurdle (1), we publish Rho checkpoints midtrained for @i2rt_robotics YAM Box, @Universal_Robot AI Trainer, and @FRANKAROBOTICS FR3 Duo, representative dual-arm robot setups across research labs and the industry. Rho itself is built on @Microsoft's own special Phi-series backbone and pretrained on robot data in the end-effector space, including UMI-style and @NVIDIARobotics Isaac Sim demonstrations, to facilitate its midtraining for other robots. Embodiment-midtrained Rho outperforms the strongest existing open-weights VLAs on physical robots and in simulation.
And then there is hurdle (2), complicated by the tendency of offline data collection to oversample the same task situations while under-sampling those where the robot's policy actually needs help. We mitigate this by pairing with Rho with online adaptation methods, particularly FlowDAgger (microsoft.github.io/FlowDAgg…, a 🏅Spotlight🏅 at #CoRL2026), which kick in after offline SFT and use online corrections for model improvement, resulting in much more data-efficient task adaptation end-to-end.
VAMs and WAMs, new zero-shot capabilities of physical AI, tactile sensing data, tactile-sensing humanoid hands, GPT-6 -- all of these hold the potential for making Rho and its successors so much more effective than we imagined just a year ago. Come to the 🤖8th Robot Learning Workshop at #NeurIPS2026 🤖 (robot-learning.ml/2026/) to geek out about these topics, and try Rho on your robots!
🙌 Congratulations to the team that has made Rho happen -- Simran Bagaria, Daphne Chen, Dean Fortier, Jianlong Fu, Michael Harrison, @TessHelleb88231, @neelsj, Dalton Moore, Galen Mullins, Michael Murray, Eduardo Salinas, and Reuben Tan! A huge shout-out to TPMs @Vivan_Amin and Ade Famoti, to @Universal_Robot for partnering with us, and to @ashleyllorens for his sponsorship and guidance in this work. Coming together from across @MSFTResearch's multiple organizations and locations in Redmond, Phoenix, New York, and Beijing, this team built more than a VLA family; it has laid a major foundation stone for @Microsoft's physical AI efforts. Truly impressive and inspiring. 🚀
#PhysicalAI #Robotics #MicrosoftResearch
Tyler Han retweeted
A nice statement from the mathematicians: mathandai.org
Tyler Han retweeted
VLAs can do a lot zero-shot. But when one fails, there's no way to tell it what went wrong - you collect more demos and retrain.
What if you could just say something?
Introducing ARCHITECT 🤖👷: a robot coding agent that synthesizes policies from free-form language instructions.
robo-architect.github.io/
🧵1/N
Tyler Han retweeted
Can we get robots to think before they act? In Latent Memory Palace, we achieve this through a classic principle: variational inference. (1/8)
Tyler Han retweeted
Is it really worth it joining a robotics hackathon?
One year ago, thousands of people around the world spent a single weekend building AI robots using the open-source LeRobot stack. Many had never built a robot before. We sat down with the winners to ask what they made and where they are now.
For many of them, that weekend changed everything, turning the intimidating field of AI robotics into an accessible hobby or even a full-time career.
Here are a few key takeaways from their year-long journey:
- You don't need a PhD to start. For many participants, this was their very first robot
- One weekend can launch a career. Winning secured internships and full-time jobs
- Community lowers the barrier to entry
- Learning by doing is exponentially faster. Robotics still requires getting your hands dirty to truly progress
Watch the full video to see their projects and hear their advice for taking the first step.
@ClementDelangue, @Thom_Wolf
Tyler Han retweeted
Congratulations to the authors of the accepted papers!!
You can find the papers here: openreview.net/group?id=rl-c…
Here is the list of reviewers that helped us organize this workshop: rlinbigworlds.ca/reviewers.h…
We would like to thank them for their work!
Tyler Han retweeted
🤖Adding new RL algorithms to LeRobot just got much easier.
Demo: HIL-SERL training with a SAC-based RL algorithm on an SO-100 for a hole-in-hand peg-in-hole task.
Sparse reward, only 30 offline demos mixed with live robot experience, and ~1 hour of online training with human interventions only when the policy fails.
The bottom graph tracks intervention rate: high at the start, steadily dropping as the policy improves.
The refactor separates algorithm logic from training infrastructure:
• RLAlgorithm owns learning logic
• RLTrainer handles orchestration
• DataMixer combines rollouts, demos, interventions, and future data sources
Adding an RL algorithm now looks much closer to adding a policy: one algorithm file, one config, one registry entry.
SAC is first. RLT, RECAP, ConRFT, QC-FQL, DSRL, and VLA RL fine-tuning next!
@Thom_Wolf @ClementDelangue
Tyler Han retweeted
Robots can learn from demonstrations… but they often learn the wrong thing.
A robot may copy how you move — without understanding what actually matters for the task.
We introduce Masked IRL, a method that uses language + demonstrations to learn what parts of the world actually matter for reward learning. As a result, the robot can use its data more efficiently and learn 5x faster.
📄 Paper:
Masked IRL: LLM-Guided Reward Disambiguation from Demonstrations and Language (ICRA 2026)
arxiv.org/abs/2511.14565
🌐 Project page:
mit-clear-lab.github.io/Mask…
🧵 1/8
Tyler Han retweeted
I’ve finally reached peak academic narcissism: according to this email, my primary research specialty is "Furong Huang." 🫠
Not only am I the subject of my own research, but I’ve also apparently mastered "distributed systems", because, as the logic goes, we "distributed" images to participants in our watermarking competition? 🤣 I love a good reach, but this is a yoga pose.
Jokes aside, to the students who are actually interested: I am truly sorry. Your thoughtful, genuine emails are being buried under a mountain of this agent-generated noise. If you want to stand out, please:
• Ditch the templates. If a bot could have written it, a human probably won't read it.
• Be specific. Mention a specific finding or a question you had about a paper, not just the title.
• Show the "Why." How does your specific background actually bridge to our work? (And no, "distributing images" doesn't count as systems experience!)
Final thought on the AI Agent Era: Attention is our most precious currency, perhaps the only truly finite resource we have left. While agents make it "free" to generate content, they make it incredibly expensive to consume it.
We have to start protecting our own attention and, more importantly, respecting the attention of others. If you don't respect someone's time enough to proofread an email, don't expect them to invest their time in your career.
#AcademicTwitter #ML #GenAI #AttentionEconomy
Tyler Han retweeted
We’re releasing OmniReset, a framework for training robot policies using large-scale RL and diverse resets for contact-rich, dexterous manipulation.
OmniReset pushes the frontier of robustness and dexterity, without any reward engineering or demonstrations.
Try the policies yourself in our interactive simulator! weirdlabuw.github.io/omnires…
(1/N 🧵)
Tyler Han retweeted
A reward model that works, zero-shot, across robots, tasks, and scenes?
Introducing Robometer: Scaling general-purpose robotic reward models with 1M+ trajectories.
Enables zero-shot: online/offline/model-based RL, data retrieval + IL, automatic failure detection, and more!
🧵 (1/12)
Tyler Han retweeted
How can we create a single navigation policy that works for different robots in diverse environments AND can reach navigation goals with high precision?
Happy to share our new paper, "VAMOS: A Hierarchical Vision-Language-Action Model for Capability-Modulated and Steerable Navigation"!
📜 Paper: arxiv.org/abs/2510.20818
🌐 Website: vamos-vla.github.io/
Tyler Han retweeted
Long Range Navigator (LRN) 🧭— an approach to extend planning horizons for off-road navigation given no prior maps. Using vision LRN makes longer-range decisions by spotting navigation frontiers far beyond the range of metric maps.
personalrobotics.github.io/l…
Tyler Han retweeted
Celebrating the #robotics community during #NationalRoboticsWeek. 👏
@UW's Wheeled Lab project is bringing sim-2-real #robotics to low-cost, open-source platforms using NVIDIA Isaac Lab.
Learn more about their work ➡️nvda.ws/4lpr6hO



















