Mechanistic interpretability and Philosophy of AI. PhD Student @epfl. Scholar @MATSProgram. Founder @philinterp.

Lausanne, Suisse
Joined February 2023
New paper: World Modeling in Transformers with @matthieu_queloz @andrenfreitas @MATSprogram Can AI models recover world models just from data? We find a faithful internal map and more inside of taxiGPT! We trace failures to how that the map is stored in superposition. 🧵(1/11)
8
64
12
483
69,544
Pierre Beckmann retweeted
check out this intuitive video on why interpretable directions in llms look non-gaussian, how ica finds them in minutes per layer, and the evaluation bug that made ica look weak for 3 years
We revisited Independent Component Analysis (ICA), a decades-old statistical method, and found that it works far better for interpreting LLM activations than we expected! This old baseline deserves a second look. Across GPT-2 Small, Gemma 2 2B, and Qwen 3.5 9B Base, we find ICA is actually competitive with the public SAEs across interpretability, sparse reconstruction, concept prediction, and targeted probe perturbation, while fitting in minutes per layer and using 7–43× less parameter memory. We're releasing ICA Lens, which lets you quickly discover, annotate, and evaluate interpretable directions in LLM residual-stream activations. No need to train another dictionary! More broadly, our results suggest that non-Gaussianity is a useful inductive bias for efficiently finding interpretable directions. Try it: pip install icalens pypi.org/project/icalens/ Paper: arxiv.org/abs/2606.11722v2 1/8
4
8
3
86
7,111
thanks for the shout-out!
New research shows transformers do build internal world models, but localization failures stem from feature superposition. Mechanistic analysis reveals how representation and routing inte… arxiv.org/abs/2609.21748 #MachineLearning #AI #LLM #DeepLearning #AgenticAI
5
326
Pierre Beckmann retweeted
"three reasons why AI isn't conscious." really? "consciousness is not intelligence": not a reason why AI isn't conscious, just rebuts a bad argument for AI consciousness (AI: intelligent therefore conscious). "consciousness is substrate-dependent"/"noncomputational": would be a reason if true, but truth needs to be established. more accurate title: "three reasons why AI might not be conscious". xitter.cf/Nature/status/21121504…
201
188
76
1,285
64,871
Pierre Beckmann retweeted
Language models can learn to detect when you read their activations. How? 🧵
82
163
114
2,153
266,294
Pierre Beckmann retweeted
What is an LLM? Is it an incomprehensible black box, a next-word-predictor, a silicon genius? To answer this, we don't have to only guess, we can open it up and look inside! It was an honor to chat with @lennysan about what we learned doing this, some takeaways in 🧵
"To make them is not to understand them." Emmanuel Ameisen (@mlpowered) has spent the last 3 years doing interpretability research at @AnthropicAI, looking inside LLMs like Claude to figure out what they're actually doing. As he puts it, models are "grown," not built. We discuss: 🔸 His discovery that models plan many tokens ahead 🔸 Why anthropomorphizing AI can actually be the right approach 🔸 What the "J-space" reveals about how models think 🔸 How interpretability connects to AI alignment and safety Listen now 👇 youtu.be/JHo-aiePjoM
8
4
48
7,412
Here’s my take on the ongoing superposition debate that followed from this great release! I think it helps to distinguish structure-driven superposition from space-saving superposition. 1/
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
2
2
1
19
1,042
Overall, Nick gives evidence that there are fewer geometry tricks than we thought, at least for MLP neurons. More widely, this points toward superposition being driven more by structure than by geometry tricks. If true, latent spaces are indeed cleaner than prev. expected. 16/
1
81
Still, I don’t think this is a paradigm shift for mech interp. We’ll still need diff-means, probes and SAEs to find features (in particular for the res stream). But I’m excited to see more attribution graphs built directly on MLP neurons! 17/
1
78