Siddhant Agarwal retweeted
Off-policy Q-Learning is known to prone to long-horizon error issues.
While multi-step/horizon-reduction methods reduce the horizon errors, they introduce off-policy bias due to sub-optimal off-policy data.
Introducing Horizon-scalable Q-Learning ✨HQL✨
Siddhant Agarwal retweeted
⏰ More time to submit! ⏰
We hope your drafts are getting into shape and we got good news! The #oopsiedata workshop @corl_conf 🤖 deadline is now October 5th. Polish up your work and send it our way! We are looking forward to all the excellent submissions!
🤖 Coming to @corl_conf 2026: The first workshop on imperfect robotics data! We’ll explore how to collect, curate & use failures 💢, OOD events❓, and unexpected human behavior 🤔 - data every lab produces but rarely documents, shares, or reuses. Check out workshop.oopsie-data.com
Siddhant Agarwal retweeted
Working on robot stuff but things didn’t work out for @ieee_ras_icra or @iclr_conf? Don’t fret, your results and data don’t have to go to waste.
At @corl_conf, we’re hosting a workshop on imperfect data. What can we do when things don’t go as planned?
🔗 workshop.oopsie-data.com/
Siddhant Agarwal retweeted
Two BIG updates for the RLBrew Workshop at #RLC2026! 📣
1️⃣ Dual submissions are welcome
2️⃣ We’ll be awarding a Best Paper RLBrew Award 🏆
You have 2 DAYS LEFT to submit — deadline: May 29!
Details: rlbrew-workshop.github.io/
Siddhant Agarwal retweeted
We are extending the submission deadline to May 29, 2026 (AoE). Submit your ideas soon!
Scalar, well-defined, easy-to-optimize rewards aren’t always available in real-world interaction data–yet that data is crucial for scaling general-purpose agents. Excited to announce the 3rd edition of RLBRew: Towards Scalable General-Purpose Agents at @RL_Conference 2026!
Siddhant Agarwal retweeted
Intelligent humanoids should have the ability to quickly adapt to new tasks by observing humans
Why is such adaptability important?
🌍 Real-world diversity is hard to fully capture in advance
🧠 Adaptability is central to natural intelligence
We present MimicDroid 👇
🌐 ut-austin-rpl.github.io/Mimi…
Siddhant Agarwal retweeted
Most assistive robots live in labs.
We want to change that.
FEAST enables care recipients to personalize mealtime assistance in-the-wild, with minimal researcher intervention across diverse in-home scenarios.
🏆 Outstanding Paper & Systems Paper Finalist @RoboticsSciSys
🧵1/8
Siddhant Agarwal retweeted
Say ahoy to 𝚂𝙰𝙸𝙻𝙾𝚁⛵: a new paradigm of *learning to search* from demonstrations, enabling test-time reasoning about how to recover from mistakes w/o any additional human feedback! 𝚂𝙰𝙸𝙻𝙾𝚁 ⛵ out-performs Diffusion Policies trained via behavioral cloning on 5-10x data!
Siddhant Agarwal retweeted
We are extending the submission deadline to June 15, 2025 (AoE). Submit your ideas soon!
⚠️ Reminder! Submissions for @RL_Conference's RL beyond Reward Workshop are due May 30 (AoE)!
We are brewing an interesting program and seeking innovative research work in reward-free RL. All papers are welcome, from exploratory abstracts to complete research papers.
Siddhant Agarwal retweeted
🤖 Want your robot to grab you a drink from the kitchen downstairs?
🚀 Introducing BUMBLE: a framework to solve building-wide mobile manipulation tasks by harnessing the power of Vision-Language Models (VLMs). 👇 (1/5)
🌐 robin-lab.cs.utexas.edu/BUMB…
Siddhant Agarwal retweeted
If you’re in Amherst, MA for RLC 2024, come to the RLHF poster session where I’ll be presenting “Learning Action-based Representations using Invariance”
We show that you can bootstrap myopic state representations to capture features relevant to long-horizon control!
Link below!
Siddhant Agarwal retweeted
🥳RLBReW Social🥳 @ RLC (@RL_Conference )
Socials are 🧡 of any conference. We invite you to join us on the evening of August 9 to discuss wacky RL ideas, and find friends and collaborators!
RSVP here: lu.ma/500nd7gj
Siddhant Agarwal retweeted
On popular demand due to the upcoming Neurips deadline, we are further extending the submission deadline to 👉23 May 2024👈 AoE! Excited to see your ideas brewing for NeurIPS. Moreover, submissions in NeurIPS format are allowed.
Siddhant Agarwal retweeted
We are extending the submission deadline to 👉9 May 2024 AOE👈! Feel free to submit preliminary work, work submitted to RLC/a first draft for NeurIPS/any other recently accepted work towards furthering the field of RL beyond Rewards.
Submission Link: openreview.net/group?id=rl-c…
Siddhant Agarwal retweeted
Excited to announce 🥁 the second speaker, Biwei Huang @huang_biwei's talk will discuss "Enhancing Reinforcement Learning through Causal Representations and Graph Structures"
Siddhant Agarwal retweeted
🥁The first confirmed speaker at the workshop is Sergey Levine (@svlevine). Sergey's talk for the RLBrew workshop will discuss "General-Purpose Self-Supervised Reinforcement Learning"
Siddhant Agarwal retweeted
Announcing the Reinforcement Learning Beyond Rewards workshop at the first @RL_Conference.
Think that rewards aren't enough for RL?
Working on RLHF? Thinking of alternative ways of alignment?
Creating a foundational model for RL? or have ideas on task-agnostic RL algo? Join us
Siddhant Agarwal retweeted
Excited to reveal ✨Tersho✨
Tersho is a Google Sheets add-on that uses AI to write and explain formulas! (coming to Excel very soon)
Here's a super cool demo:
loom.com/share/ff511bb23b074…




















