Pinned Tweet
There’s huge potential in using ‘demonstrations’ from other agents with different goals: to understand which features & dynamics of the environment *might* be important to you; and to borrow from others' behaviours only where they are useful for you.
👽 PsiPhi-learning 👽 (long talk #ICML) sites.google.com/view/psiphi… shows how an agent can use data from the behavior of other agents with diverse goals: to infer their intentions and fulfill its own! 🧵
This was a great project to work on. Happy to have it published now in @Nature! Meta-learning is important.
Excited to announce that our work on “Discovering state-of-the-art RL algorithms” is finally published in @Nature! In this work, we meta-learned RL algorithms at scale.
Paper: nature.com/articles/s41586-0…
Blog: google-deepmind.github.io/di…
See thread 👇
There are a bunch of ideas in this paper, but it all fits together really neatly! Great work from @filangelos and team 👏
Permanent damage to generalisation from early updates in non-stationary training -- really enjoyed looking into this intriguing problem and trying to solve it for deep RL agents!
Really excited about our new work: In deep RL, we typically collect new data using a non-stationary policy that gets updated as we learn and improve. We show this can impact the learning dynamics of our deep policy and lead to worse generalization arxiv.org/abs/2006.05826 (1/7)
This is awesome, but I'm a little scared of how much time I might spend playing it myself...
Greg Farquhar retweeted
I am proud to announce the release of the NetHack Learning Environment (NLE)! NetHack is an extremely difficult procedurally-generated grid-world dungeon-crawl game that strikes a great balance between complexity and speed for single-agent reinforcement learning research. 1/
I particularly enjoyed visualising & analysing the learned mixing functions that combine per-agent utilities into joint values!
Happy to share the extended version of our #QMIX paper “Monotonic Value Function Factorisation for Deep Multi-Agent RL”
We include further analysis and ablation studies that investigate how monotonic factorisation of joint Q-val helps QMIX outperform VDN
arxiv.org/abs/2003.08839
A much-improved 🎲Loaded DiCE🎲 objective lets you easily compute low-variance estimators of any-order derivatives for RL. Paper arxiv.org/abs/1909.10549 and code github.com/oxwhirl/loaded-di… online, nice working with @shimon8282 and @j_foerst! #NeurIPS2019
Greg Farquhar retweeted
Tuomas Sandholm and I are doing a Reddit AMA now on the #Pluribus poker AI!
reddit.com/r/MachineLearning…
AI accelerates by 10x in the hour it takes to repost from r/machinelearning to r/singularityisnear... just how near is it at that rate?? 😱
Progressively growing the action space creates a great curriculum for learning agents -- check out our paper: arxiv.org/abs/1906.12266 + code: github.com/TorchCraft/TorchC…. Great working with Laura Gustafson @ebetica @shimon8282 Nicolas Usunier @syhw
Greg Farquhar retweeted
How can RL agents exploit the compositional, relational and hierarchical structure of the world? A growing number of authors propose learning from natural language. We are excited to share our @IJCAIconf survey of this emerging field! arxiv.org/abs/1906.03926
TL;DR:🤖+📖=📈🎯🏆🥳
Greg Farquhar retweeted
I had the pleasure to co-supervise outstanding MSc students jointly with Jakob Foerster (@j_foerst) and Greg Farquhar (@greg_far) at @CompSciOxford this year. Together, we compiled our advice for embarking on short-term machine learning research projects: rockt.github.io/2018/08/29/m…
Greg Farquhar retweeted
I am very excited to share our ICML paper “Deep Variational Reinforcement Learning (DVRL) for POMDPs”: Our agent learns a model of the environment and acts based on its belief state in this model. w/ @zinmalu @tuananhle7 @frankdonaldwood @shimon8282 arxiv.org/abs/1806.02426
Greg Farquhar retweeted
Our latest paper: how to learn complex joint value functions for teams of agents whose greedy policies can be computed and executed in a decentralised fashion. The trick is a new monotonic value function factorisation. With results on StartCraft 2! arxiv.org/abs/1803.11485
The camera-ready of our #ICLR2018 paper “TreeQN and ATreeC: Differentiable Tree-Structured Models for Deep Reinforcement Learning” is now online arxiv.org/abs/1710.11417. Code is available at github.com/oxwhirl/treeqn/ @_rockt @MaxiIgl @shimon8282 @whi_rl
Greg Farquhar retweeted
Excited to share "DiCE: The Infinitely Differentiable Monte Carlo Estimator": arxiv.org/abs/1802.05098 Try this one weird objective for correct any-order gradient estimators in all your stochastic graphs ;) With fantastic Oxford/CMU team: @greg_far @alshedivat @_rockt @shimon8282
