
Physics-AI fellow @Cambridge_Uni explaining the scientific principles behind AI. Formerly @EPFL, @Amazon AI.
Cambridge & London, UK
Joined September 2020
- Tweets188
- Following977
- Followers751
- Likes1.2K
Pinned Tweet
AI needs vastly more data than we do. One idea might close the gap: don't predict raw signals (tokens), predict your own abstract latent representation (JEPA, data2vec).
With @DanKorchinski @MatthieuWyart, on a toy model, we prove how much that helps: the gap is exponential.
🧵
Alessandro Favero retweeted
We @bold_lab_ai are hiring a large cohort of home and overseas students for Fall 2027 entry. If you’re excited about discovering the next paradigm of open-source AI and want to work on ambitious, exploratory, but scalable ML that empowers humanity, please apply by 1st of December 2026 AOE to maximise chances of funding: eng.ox.ac.uk/study/research-…
Alessandro Favero retweeted
What can you tell from an LLM response that reads [MASK] [MASK] [MASK]? Apparently enough to detect jailbreaks in masked diffusion language models!
In our NeurIPS paper, we found that some jailbreaks were easier to detect using those masks than with the prompt itself. (1/6) 🧵
Alessandro Favero retweeted
What if an LLM could adapt its layer order to each input?
What if it learned a different layer order for each classic algorithm that solves Sudoku or mazes, and you could fix that order at inference to choose which algorithm it runs?
Meet LoL in under 4 minutes 🎥 (1/3)
Alessandro Favero retweeted
🔥 Diffusion LMs promise what autoregressive models can’t: fixing their mistakes.
But new ones often change the noise and the sampler at once. Which matters?
We tested it on the hypersphere. Noise: 0.8 points. Sampler: 25.
We introduce Spherical Brownian Diffusion 🌐 👇🧵
Alessandro Favero retweeted
Interested in building what’s next in AI for Science? Join us at PolymathicAI in New York (NYU + Flatiron).
We are looking for: Interns, Postdoctoral Researchers, Research Scientists and Research Engineers.
Submit your interest here: forms.gle/EMfMccvPZ3S19BLD6
Alessandro Favero retweeted
Can a language model be based purely on self-conditioning? 🤔
Yes! Meet LAW 👋 (a.k.a. Loopholing All the Way!)
🧵1/8
Alessandro Favero retweeted
If you're not surprised, you didn't understand it…🙃
Turns out we can train generative models purely through self-conditioning!
Really happy with the outcome of this collaboration! Huge thanks to @nadjushenka_, @DeschenauxAdri, @jdeschena, and the rest of the team! 🙌
Alessandro Favero retweeted
Two years of work, and PySR v2 is finally out!
If you haven't used it before: PySR is a machine learning library that finds short equations that fit your data.
I've always wanted a PyTorch for symbolic learning. PySR v2 is a big step towards that:
Alessandro Favero retweeted
Model: journals.aps.org/prx/abstrac…
Connection to real data via diffusion: pnas.org/doi/10.1073/pnas.24…, openreview.net/pdf?id=0GzqVq…
Language modelling and scaling laws: openreview.net/pdf?id=NaCXcU…, journals.aps.org/pre/abstrac…
Creativity: openreview.net/pdf?id=1OUEnf…
Parsing: openreview.net/pdf?id=mJgkPA…
Provable depth separation: arxiv.org/pdf/2601.19756
Latent world models: arxiv.org/abs/2605.27734
Platonic representation Hyp: arxiv.org/pdf/2610.07168
Alessandro Favero retweeted
Whatever you make of already-clean.goodfire.com/, it has brought compositionality and generalisation back into the spotlight. I’d like to see more rigorous work testing these ideas.
The Random Hierarchy Model is one example. By controlling the data's compositional structure, we recover several key features of deep learning: advantage of depth, scaling laws, linear representations and circuits.
Well-motivated toy models are invaluable: they help us explain how these phenomena fit together and make falsifiable predictions about real data.
Fun fact: @nickcammarata and colleagues’ earlier “Zoom In” work inspired the RHM, back when we were still thinking about cats and dogs.
Alessandro Favero retweeted
(1/7)
Why do different languages/modalities have similar "platonic" representations in neural networks? Why does similarity peak in the middle layers of LLMs? When does it enable cross-lingual transfer?
Our new paper develops a theory based on shared hierarchical structure. 🧵
Alessandro Favero retweeted
DINOv2 has never seen a caption, and Qwen3 has never seen an image. We still aligned their embedding spaces without a single image-caption pair.
It even works when the images and the captions come from different datasets.
Project page: dominik-schnaus.github.io/un…
⬇️
Alessandro Favero retweeted
The Bitter Lesson for harness design and formal math!
Instead of hand-designing how an AI should prove (decompose, plan, assign agents), what if we just give a frontier model good Lean feedback and let it keep working?
We built h1.
TL;DR:
→ SOTA on formal theorem proving benchmarks
→ can solve open conjectures
→ matches/beats hand-designed workflows
→ one long attempt can beat many retries
[1/7]
Alessandro Favero retweeted
A multilingual LLM encodes a sentence and its translation almost identically - the “platonic representation hypothesis.” Observed, never explained. The facts pile up: similarity peaks in the middle layers (not the ends), coexists with language-specific structure, and grows with language proximity, model quality, and data. We explain all of them -and predict something new: remove from each layer the part linearly predictable from the previous one, and cross-lingual similarity rises. Confirmed in real LLMs.
Alessandro Favero retweeted
Say hi to PUMBA! 🐗
Masked diffusion language models are trained one way and sampled another.
Our new paper studies how to make MDM training more aware of the trajectories followed at inference, and how this can lead to more efficient text generation.
Paper link below 🧵
Alessandro Favero retweeted
Mislabeled 3D protein structures risk polluting public scientific databases and misleading critical downstream research.
So today in @nature, we're announcing SynthID Bio to watermark generated protein sequences and structures.
deepmind.google/blog/introdu…
Alessandro Favero retweeted
🔺Happy to share a project done during my internship🔻 It was amazing to collaborate 🥹 @ValentinDeBort1 @ArnaudDoucet1 @agalashov @AndrewC_ML @JamesTThorn and Kevin Li (who I cannot find on Twitter)
Alessandro Favero retweeted
We are having our first @SimonsFdn yearly meeting on the Physics of Learning and Neural Computation Sept 24th-25th and all are welcome to join on this zoom:
simonsfoundation.zoom.us/j/9…
We have an excellent set of speakers. Here is the agenda:
simonsfoundation.org/event/s…
Join our webinar starting Sept 24th 9:30am ET to learn how the structure of data, architectures, and learning dynamics conspire to empower AI to learn, scale, compute, imagine, reason and collaborate!
See physicsoflearning.org/ for more about our collaboration.
Alessandro Favero retweeted
📢 2nd Workshop on Principles of Generative Modelling (PriGM) at NeurIPS 2026 Paris:
sites.google.com/view/prigmn…
Deadline: September 5th, AoE































