Research Scientist at Google DeepMind
Joined January 2013
- Tweets21
- Following96
- Followers224
- Likes104
Azade Nova retweeted
This is exactly why open-source frameworks like FeynRL matter more than ever. Open weights are NOT enough. Open AI needs open training recipes, alg, etc.
You should be able to understand training, modify it, & build new algorithms, optimizers, recipes.
github.com/FeynRL-project/Fe…
Azade Nova retweeted
Interested in learning more about ML for Systems research at Google? Stop by the booth today at 10:30 am to hear @martin_maas discuss the latest in ML-driven systems! And if you want to learn more about the area, join the ML for Systems workshop on Saturday, December 3rd.
Azade Nova retweeted
Join us on Saturday, December 3 at #NeurIPS2022 for the 6th edition of the ML for Systems workshop. We have an exciting program with 5 invited talks and 19 accepted papers, as well as plenty of opportunities to chat with researchers in the area. mlforsystems.org
Azade Nova retweeted
As a 4th time organizer, I must say we have an amazing program this year at ML for Systems at NeurIPS.
Before I forget —
Organizers @martin_maas @Azade_na @BenoitSteiner Neel Kant @DZhang50
Steering @annadgoldie @Azaliamirh @jonathanrraiman @miladhash @kswersk
+ PC.
🙏
Azade Nova retweeted
🔥 LLMs can do OOD reasoning:We show that we can teach algorithms to LLMs with only three examples and it generalizes to much longer input length as much as the context length allows! We can also teach multiple algorithms,compose them to teach complex ones & use them as tools! 🔥
“LLMs can’t even do addition”
📄🚨We show that they CAN add! To teach algos to LLMs, the trick is to describe the algo in enough detail so that there is no room for misinterpretation
w/ @Azade_na @hugo_larochelle @AaronCourville @bneyshabur @HanieSedghi
arxiv.org/abs/2211.09066
Azade Nova retweeted
Excited to share that our work has been published in Nature! Our RL agent generates chip layouts in just a few hours, whereas human experts can take months. These superhuman AI-generated layouts were used in Google's latest AI accelerator (TPU-v5)! nature.com/articles/s41586-0…
Azade Nova retweeted
Thrilled to announce that our work on RL for chip floorplanning was published in Nature & used in production to design next generation Google TPUs, with potential to save thousands of hours of engineering effort for each next generation ASIC:
nature.com/articles/s41586-0… (1/7)
ALT Image by Google internal agency Hook.
Azade Nova retweeted
Autoregressive graph generation is powerful but slow. Our recent work reduces its complexity from O(V^2) to O((E+V) log V), with sublinear mem cost and training parallelism.
Paper: arxiv.org/abs/2006.15502
Code: github.com/google-research/g…
w/ @Azade_na @liyuajia @daibond_alpha Dale
Azade Nova retweeted
Check out TraDE, our new transformer based density estimator arxiv.org/abs/2004.02441. It beats NAF, BNAF, TAN, FFJORD, NSF, AEM on reference datasets. Works well for #bumblebee, too (left: original, right: estimate). @rasoolfa @pratikac and Jonas Mueller are the real stars here.
Azade Nova retweeted
Today we are excited to release video recordings of lectures from "Advanced Deep Learning and Reinforcement Learning", a course on deep RL taught at @UCL earlier this year by DeepMind researchers:
youtube.com/playlist?list=PL…
Enjoy!
Azade Nova retweeted
We've seen @BostonDynamics' infamous robot dog open doors, and climb stairs. But now it can navigate complicated construction sites, and do detailed work inspections too 👀: wired.trib.al/0CcVEmR
Azade Nova retweeted
If you want to do ML research, consider applying for the 2019 Google AI Residency program! You'll have the opportunity to conduct cutting-edge research working in a wide variety of areas, and this year we're expanding to host residents in even more locations.
Applications for the 2019 Google AI Residency program are now open! Visit g.co/airesidency/apply for more information on how to apply. To learn more about the accomplishments of the recently graduated second class of residents, visit ↓ goo.gl/5QZbsF
Azade Nova retweeted
the paper behind BERT is now online: arxiv.org/abs/1810.04805
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova arxiv.org/abs/1810.04805
