Pinned Tweet
Replying to @DavidDuvenaud
@DavidDuvenaud and I have a new microscope to look at the beliefs LLMs have about all sorts of quantities. What should we point it at?
LLMs have complex joint beliefs about all sorts of quantities. And my postdoc @jamesrequeima visualized them! In this thread we show LLM predictive distributions conditioned on data and free-form text.
LLMs pick up on all kinds of subtle and unusual structure: 🧵
James Requeima retweeted
🌡️ Breakthrough: Canadian AI revolutionizes weather forecasting
Vector postdoc @jamesrequeima co-developed Aardvark Weather, transforming climate prediction globally. This AI-powered system delivers forecasts 10x faster while using 1000x less computing power than traditional methods.
Game-changing features:
+ Runs on a desktop computer (no supercomputer needed)
+ Processes satellite, weather station, ship, & plane data simultaneously
+ Outperforms US national forecasting systems
+ Can provide 10-day advance predictions with higher accuracy
Real-world impact:
🌲 Wildfire prevention in BC
🌊 Flash flood warnings in Toronto
🌾 Agricultural planning
⚡️ Renewable energy optimization
Most importantly? This innovation democratizes access to precise weather forecasting, especially benefitting remote communities and developing nations.
Read our full story on how this innovation is shaping climate science:
vectorinstitute.ai/aardvark-…
James Requeima retweeted
Context is Key🗝️ is accepted at ICML 2025! 📈
Let's catch up if you'll be at ICML 🛬
See the poster and tweet thread below for a preview of CiK 👇
xitter.gq/arjunashok37/status/18…
And stay tuned for new results ;)
James Requeima retweeted
.@jamesrequeima gave the third invited talk of the day at #AABI2025!
**LLM Processes**
James Requeima retweeted
Understanding causes is key to science. Finite observational data alone isn't enough. While Bayes offers a framework to deal with this, the calculations are often intractable. We introduce a method to accurately approximate the posterior over causal structures.
#ICLR2025 🧵1/15
Happy to have been a part of the great team that produced this report!
Food prices in Canada likely to increase by 3 to 5% next year: Canada's Food Price Report 2025 globalnews.ca/news/10903026/…
1
829
James Requeima retweeted
(New paper alert!)
Forecasting models typically rely on numerical historical data. However, in many cases, numerical data is insufficient and context is key.
E.g., In the series below, would you have predicted the drop? Even the best models do not (forecast in blue).
James Requeima retweeted
Really excited about this! We've put effort into making the model accessible with code that fits in a Tweet. 😊
pip install microsoft-aurora
from aurora import Aurora
model = Aurora()
model.load_checkpoint("microsoft/aurora", "aurora-0.25-finetuned.ckpt")
1/5 Excited to announce the public code release of Aurora - a foundation model for atmospheric forecasting! 🌎⛅️
Code: github.com/microsoft/aurora
Docs: microsoft.github.io/aurora
Paper: arxiv.org/abs/2405.13063
James Requeima retweeted
📢 Excited to announce 'Environmental sensor placement with convolutional Gaussian neural processes', out now in @EnvDataScience
Paper: cambridge.org/core/services/…
Talk: youtu.be/v0pmqh09u1Y
Code: github.com/tom-andersson/dee…
@BAS_News @Cambridge_Uni @turinginst
🧵 1/n
James Requeima retweeted
Where should we measure the environment to minimise uncertainty about weather and climate? 🎲⛅
I'm excited to share that my second journal paper, which grapples with this fascinating problem, will be published soon!
Interested? Check out my 15-min talk: youtu.be/v0pmqh09u1Y
James Requeima retweeted
QUIZ: One of these plots shows temperature around Antarctica. The others are samples from a model conditioned on obs at the black circles. Which one is the true data?
Find it tough? That's the power of the AR ConvCNP.
Answer below & check out @ikwess's🧵on our #ICLR2023 paper👇
Happy to announce our #ICLR2023 paper Autoregressive Conditional Neural Processes!
w/ @stratosmarkou, @jamesrequeima, @AndrewFoongYK, @tom_r_andersson, Anna Vaughan, Anthony Buonomo, @scotthosking, Rich Turner
Paper: arxiv.org/abs/2303.14468
Code: github.com/wesselb/neuralpro…
🧵1/4
James Requeima retweeted
Happy to announce our #ICLR2023 paper Autoregressive Conditional Neural Processes!
w/ @stratosmarkou, @jamesrequeima, @AndrewFoongYK, @tom_r_andersson, Anna Vaughan, Anthony Buonomo, @scotthosking, Rich Turner
Paper: arxiv.org/abs/2303.14468
Code: github.com/wesselb/neuralpro…
🧵1/4
James Requeima retweeted
Great presentation from @tom_r_andersson on day 2 @Climformatics 🎉 Active learning improve how we understand the Antarctic. Impressive work. See the paper here: arxiv.org/abs/2211.10381
James Requeima retweeted
I'm very excited to announce the release of Plum 2.0!
With this release, Plum is fully powered by Beartype, which means that Plum now supports any type supported by Beartype.
And that's not all: Plum is now proudly a member of the Beartype org!
github.com/beartype/plum
James Requeima retweeted
I should have announced this before, but a year ago I switched my research focus to AI existential risk reduction and governance. I think the risk of bad outcomes for humanity due to AGI is substantial, and that coordinating a slowdown in AGI development is probably a good idea.
James Requeima retweeted
📢Thrilled to be presenting 'Environmental Sensor Placement with Convolutional Gaussian Neural Processes' at a #NeurIPS22 workshop
🗞️Poster gp-seminar-series.github.io/…
📰Paper arxiv.org/abs/2211.10381
🤝Collaboration betw @BAS_News & @CambridgeMLG
💲Funded by @turinginst
👇More below
James Requeima retweeted
Replying to @ylecun
Yes ok, but why do they have to shout so much while they're learning?
James Requeima retweeted
Still using latent variables to get correlations out of your Neural Process?
Then consider Gaussian Neural Processes (GNP)!
✓ Correlated predictions
✓ Tractable likelihood
@stratosmarkou, @jamesrequeima, @ikwess, Anna Vaughan & Rich Turner #ICLR2022
arxiv.org/abs/2203.08775
James Requeima retweeted
Did you miss our second @Cambridge_Uni ELLIS Unit seminar in @Cambridge_Eng with Prof. Richard Turner, a leading researcher in the area of #machinelearning and #AI. Please see the seminar here: youtube.com/watch?v=70n5cA7U…
James Requeima retweeted
Ever wondered why variational inference + natural gradients + neural networks might be a good idea? Are you curious to follow the details of the mathematical derivations? I wrote a blog post on the new @CambridgeMLG blog: mlg-blog.com/2021/04/13/ngvi… 1/3
James Requeima retweeted
Replying to @CambridgeMLG
@CambridgeMLG is launching a blog, featuring a first two-part post about what keeps a Bayesian awake at night by Richard E. Turner and me. 🧵
mlg-blog.com/
























