@neuronpedia please try your best to be honest
san francisco
Joined January 2009
- Tweets25
- Following4
- Followers584
- Likes57
johnny retweeted
New Anthropic research: A global workspace in language models.
Of everything happening in your brain right now, only a tiny fraction is consciously accessible—thoughts you can describe, hold in mind, and reason with.
We found a strikingly similar divide inside Claude.
johnny retweeted
Researchers can use the Neuronpedia interactive interface here: neuronpedia.org/gemma-2-2b/g…
And we’ve provided an annotated walkthrough: github.com/safety-research/c…
This project was led by participants in our Anthropic Fellows program, in collaboration with Decode Research.
johnny retweeted
Announcement: we're open sourcing Neuronpedia! 🚀
This includes all our mech interp tools: the interpretability API, steering, UI, inference, autointerp, search, plus 4 TB of data - cited by 35+ research papers and used by 50+ write-ups.
What you can do with OSS Neuronpedia: 🧵
johnny retweeted
Neuronpedia now hosts Chain-of-Thought! Steer and inspect Deepseek-R1-Distill-Llama-8B with SAEs trained by @Open_MOSS on @neuronpedia (linked below). One fun initial result: the model can easily be steered into "overthinking/anxious" mode with a single latent.
johnny retweeted
Google DeepMind has a new way to look inside an AI’s “mind” trib.al/UN5W3Uh
johnny retweeted
Gemma Scope allows us to study how features evolve throughout the model and interact to create more complex ones.
Want to learn more? Here’s an interactive demo made by @neuronpedia - no coding necessary ↓ dpmd.ai/gemma-scope
johnny retweeted
Want to learn more? @neuronpedia have made a gorgeous interactive demo walking you through what Sparse Autoencoders are, and what Gemma Scope can do.
If this could happen pre-launch, I'm excited to see what the community will do with Gemma Scope now!
neuronpedia.org/gemma-scope
johnny retweeted
Sparse Autoencoders act like a microscope for AI internals. They're a powerful tool for interpretability, but training costs limit research
Announcing Gemma Scope: An open suite of SAEs on every layer & sublayer of Gemma 2 2B & 9B! We hope to enable even more ambitious work
johnny retweeted
Super impressed by @johnnylin's Interactive Interface for exploring my GPT2 Small SAE Features. neuronpedia.org/gpt2-small/r….
First 5000 for each layer are there with the rest coming shortly! We've updated the feature-activation highlighting to better show multiple fires per context!
johnny retweeted
Openly Operated wants to make privacy policies actually mean something theverge.com/2019/6/18/18682…
