Siddhant Agarwal (@agsidd10) profile picture

PhD CS @UTAustin | Reinforcement Learning & Robotics, prev intern @Amazon, @Nuro

Austin, USA
Joined November 2013
Photo by Siddhant Agarwal (@agsidd10)Photo by Siddhant Agarwal (@agsidd10)Photo by Siddhant Agarwal (@agsidd10)Photo by Siddhant Agarwal (@agsidd10)
Siddhant Agarwal retweeted
Off-policy Q-Learning is known to prone to long-horizon error issues. While multi-step/horizon-reduction methods reduce the horizon errors, they introduce off-policy bias due to sub-optimal off-policy data. Introducing Horizon-scalable Q-Learning ✨HQL✨
2
20
2
133
7,313
Siddhant Agarwal retweeted
⏰ More time to submit! ⏰ We hope your drafts are getting into shape and we got good news! The #oopsiedata workshop @corl_conf 🤖 deadline is now October 5th. Polish up your work and send it our way! We are looking forward to all the excellent submissions!
🤖 Coming to @corl_conf 2026: The first workshop on imperfect robotics data! We’ll explore how to collect, curate & use failures 💢, OOD events❓, and unexpected human behavior 🤔 - data every lab produces but rarely documents, shares, or reuses. Check out workshop.oopsie-data.com
1
5
1
13
1,543
Siddhant Agarwal retweeted
Working on robot stuff but things didn’t work out for @ieee_ras_icra or @iclr_conf? Don’t fret, your results and data don’t have to go to waste. At @corl_conf, we’re hosting a workshop on imperfect data. What can we do when things don’t go as planned? 🔗 workshop.oopsie-data.com/
2
1
141
Two BIG updates for the RLBrew Workshop at #RLC2026! 📣 1️⃣ Dual submissions are welcome 2️⃣ We’ll be awarding a Best Paper RLBrew Award 🏆 You have 2 DAYS LEFT to submit — deadline: May 29! Details: rlbrew-workshop.github.io/
1
6
11
1,312
We are extending the submission deadline to May 29, 2026 (AoE). Submit your ideas soon!
Scalar, well-defined, easy-to-optimize rewards aren’t always available in real-world interaction data–yet that data is crucial for scaling general-purpose agents. Excited to announce the 3rd edition of RLBRew: Towards Scalable General-Purpose Agents at @RL_Conference 2026!
7
8
1,682
Meta has gone crazy on the squid game! Many new PhD NGs are deactivated today (I am also impacted🥲 happy to chat)
Several of my team members + myself are impacted by this layoff today. Welcome to connect :)
109
89
21
2,005
1,360,193
Siddhant Agarwal retweeted
Intelligent humanoids should have the ability to quickly adapt to new tasks by observing humans Why is such adaptability important? 🌍 Real-world diversity is hard to fully capture in advance 🧠 Adaptability is central to natural intelligence We present MimicDroid 👇 🌐 ut-austin-rpl.github.io/Mimi…
7
38
15
126
43,634
Most assistive robots live in labs. We want to change that. FEAST enables care recipients to personalize mealtime assistance in-the-wild, with minimal researcher intervention across diverse in-home scenarios. 🏆 Outstanding Paper & Systems Paper Finalist @RoboticsSciSys 🧵1/8
5
64
17
323
69,567
Reminder! The deadline in coming up in 5 days. Submit your works soon. You can submit your under-review NeurIPS papers too.
We are extending the submission deadline to June 15, 2025 (AoE). Submit your ideas soon!
3
1
7
2,906
Siddhant Agarwal retweeted
Say ahoy to 𝚂𝙰𝙸𝙻𝙾𝚁⛵: a new paradigm of *learning to search* from demonstrations, enabling test-time reasoning about how to recover from mistakes w/o any additional human feedback! 𝚂𝙰𝙸𝙻𝙾𝚁 ⛵ out-performs Diffusion Policies trained via behavioral cloning on 5-10x data!
9
87
22
264
91,378
We are extending the submission deadline to June 15, 2025 (AoE). Submit your ideas soon!
⚠️ Reminder! Submissions for @RL_Conference's RL beyond Reward Workshop are due May 30 (AoE)! We are brewing an interesting program and seeking innovative research work in reward-free RL. All papers are welcome, from exploratory abstracts to complete research papers.
8
1
25
6,494
Siddhant Agarwal retweeted
🤖 Want your robot to grab you a drink from the kitchen downstairs? 🚀 Introducing BUMBLE: a framework to solve building-wide mobile manipulation tasks by harnessing the power of Vision-Language Models (VLMs). 👇 (1/5) 🌐 robin-lab.cs.utexas.edu/BUMB…
7
37
11
171
38,008
Siddhant Agarwal retweeted
If you’re in Amherst, MA for RLC 2024, come to the RLHF poster session where I’ll be presenting “Learning Action-based Representations using Invariance” We show that you can bootstrap myopic state representations to capture features relevant to long-horizon control! Link below!
1
4
1
19
2,992
🥳RLBReW Social🥳 @ RLC (@RL_Conference ) Socials are 🧡 of any conference. We invite you to join us on the evening of August 9 to discuss wacky RL ideas, and find friends and collaborators! RSVP here: lu.ma/500nd7gj
1
7
3
16
4,953
On popular demand due to the upcoming Neurips deadline, we are further extending the submission deadline to 👉23 May 2024👈 AoE! Excited to see your ideas brewing for NeurIPS. Moreover, submissions in NeurIPS format are allowed.
4
2
7
6,509
We are extending the submission deadline to 👉9 May 2024 AOE👈! Feel free to submit preliminary work, work submitted to RLC/a first draft for NeurIPS/any other recently accepted work towards furthering the field of RL beyond Rewards. Submission Link: openreview.net/group?id=rl-c…
2
8
11
5,225
Excited to announce 🥁 the second speaker, Biwei Huang @huang_biwei's talk will discuss "Enhancing Reinforcement Learning through Causal Representations and Graph Structures"
2
14
968
🥁The first confirmed speaker at the workshop is Sergey Levine (@svlevine). Sergey's talk for the RLBrew workshop will discuss "General-Purpose Self-Supervised Reinforcement Learning"
2
18
627
Announcing the Reinforcement Learning Beyond Rewards workshop at the first @RL_Conference. Think that rewards aren't enough for RL? Working on RLHF? Thinking of alternative ways of alignment? Creating a foundational model for RL? or have ideas on task-agnostic RL algo? Join us
1
15
3
64
23,843