Breakthrough AI to solve the world's biggest problems. › Join us: https://xitter.gq/t.co/MjUpZpKi8b › Newsletter: https://xitter.gq/t.co/k9gGznrVGL
Seattle, WA
Joined September 2015
- Tweets4.1K
- Following451
- Followers87.3K
- Likes3.7K
Pinned Tweet
We’re introducing ToyBlocks, an open simulated tabletop for controlled experiments in robot learning.
It enables robotics researchers to experimentally control training data & models, run targeted evals, & trace failures to their causes. 🧵
github.com/allenai/ToyBlocks
Ai2 retweeted
What could we learn about robot foundation models if we could systematically generate data at scale, with precise control over what varies?
Excited to see ToyBlocks launch as a principled step toward answering these questions, and to see what new research directions it unlocks!
We’re introducing ToyBlocks, an open simulated tabletop for controlled experiments in robot learning.
It enables robotics researchers to experimentally control training data & models, run targeted evals, & trace failures to their causes. 🧵
github.com/allenai/ToyBlocks
Ai2 retweeted
ToyBlocks is out! Huge congrats to the Ai2 Robotics team! Having watched this effort take shape at Ai2, I’ve seen firsthand how ambitious and challenging it has been—and the insight, hard work, perseverance, resilience, and resources it has taken to bring it to life. Even as an outside observer, I’ve learned so much from the team. I have enormous respect for what you’ve accomplished and am truly happy for you all. I hope this work proves valuable to the entire robotics community!
We’re introducing ToyBlocks, an open simulated tabletop for controlled experiments in robot learning.
It enables robotics researchers to experimentally control training data & models, run targeted evals, & trace failures to their causes. 🧵
github.com/allenai/ToyBlocks
Ai2 retweeted
Sharing what I spent the last year working on before starting my PhD. Glad it’s finally released! 🧱🤖
Robot foundation models have made huge progress with scale, but it’s getting harder to tell which choices actually drive the gains. I strongly believe many design choices are still understudied: data mixtures, input modalities, architectures, training recipes, and now how agentic frontier models should plan and act through robot skills.
Answering that takes systematic ablations, which need a system where you can 1. design tasks 2. generate data in a controllable way, and 3. train and evaluate models end to end.
That’s what ToyBlocks is built for. Excited to see what the community learns with it!
We’re introducing ToyBlocks, an open simulated tabletop for controlled experiments in robot learning.
It enables robotics researchers to experimentally control training data & models, run targeted evals, & trace failures to their causes. 🧵
github.com/allenai/ToyBlocks
Ai2 retweeted
This was one of the last projects I contributed to in my PhD and it’s awesome to see it finally released!
With scale we need better tools to make more fine-grained analysis of our models and algorithms. Complex-looking tasks may be cool and high-value, but are not always the highest signal for research and iteration.
Simulation of an “easy to simulate” but “difficult to master” domain of tasks lets us get more scale with minimal sim-to-real gaps, while letting you test on a incredibly diverse set of problems. From non-prehensile movements / dexterity, to higher-level reasoning.
Stay tuned to what AI2 is working on to advance open-source robotics!
We’re introducing ToyBlocks, an open simulated tabletop for controlled experiments in robot learning.
It enables robotics researchers to experimentally control training data & models, run targeted evals, & trace failures to their causes. 🧵
github.com/allenai/ToyBlocks
Ai2 retweeted
Excited to finally share ToyBlocks! 🧱
A fully open simulated setting where you control the data, the models and the evals, so when a robot policy fails you can actually trace why.
Assets, data generators, 85K demos, training + eval code, all open. Try it out!👇
We’re introducing ToyBlocks, an open simulated tabletop for controlled experiments in robot learning.
It enables robotics researchers to experimentally control training data & models, run targeted evals, & trace failures to their causes. 🧵
github.com/allenai/ToyBlocks
Ai2 retweeted
ToyBlocks is out! 🚀
At Ai2, we’re always exploring how simulation can help scale data generation, benchmarking, and experimentation to push robotics research forward.
MolmoSpaces, MolmoBOT earlier this year, and now ToyBlocks! :)
We’re introducing ToyBlocks, an open simulated tabletop for controlled experiments in robot learning.
It enables robotics researchers to experimentally control training data & models, run targeted evals, & trace failures to their causes. 🧵
github.com/allenai/ToyBlocks
We’re targeting a larger dataset, more skills, & broader benchmarks in a follow-up release, as well as integrated reinforcement learning training.
Longer-term research will include two-arm manipulation & hands with force & touch sensors.
We hope ToyBlocks is a step toward robots that can apply what they learn to unfamiliar tasks and environments.
We’re releasing simulation assets, task & demonstration generators, 2 trained models, training code, evaluation code, & validation sets.
📝 Blog: allenai.org/blog/toyblocks
Ai2 retweeted
We’re teaming up with @Google on NeuralGCM+ for faster, more reliable climate projections.
Multimillion-dollar, 3-year funding from Google.org & support from Google Research will expand our team—& we’ll open-source models & workflows. 🧵
allenai.org/blog/google-clim…
We’re teaming up with @Google on NeuralGCM+ for faster, more reliable climate projections.
Multimillion-dollar, 3-year funding from Google.org & support from Google Research will expand our team—& we’ll open-source models & workflows. 🧵
allenai.org/blog/google-clim…
Our Ai2 Climate Emulator (ACE) has already sped up climate simulations.
Our priorities for NeuralGCM+:
🌊 Couple atmosphere, ocean, & sea ice
🌡️ Add physics & test warmer climates
💻 Release models, frameworks, & documented workflows; improve GPU performance
