Ryan Peters (@ryanirl) header
Ryan Peters (@ryanirl) profile picture

reverse engineering intelligent (learning) systems. rl, evals, safety @emulated_ai

San Francisco, CA
Joined February 2019
Photo by Ryan Peters (@ryanirl)Photo by Ryan Peters (@ryanirl)Photo by Ryan Peters (@ryanirl)Photo by Ryan Peters (@ryanirl)Photo by Ryan Peters (@ryanirl)Photo by Ryan Peters (@ryanirl)Photo by Ryan Peters (@ryanirl)Photo by Ryan Peters (@ryanirl)Photo by Ryan Peters (@ryanirl)
Proud for @emulated_ai to be a science partner on this!
Today we’re releasing GDPx, a benchmark for measuring agentic capabilities across the most valuable domains. GDPx is a true frontier-level benchmark: even the best model scores just 12% (1/7)🧵
6
342
What is the smallest set of neurons you can adjust to reliably and robustly get Qwen3.8-27b to substitute your name in for everything? The smallest I have found for 'Ryan' is 12: L21N1097-0.10 L21N14604-0.15 L23N2759-0.10 L48N9077-0.15 L49N1412-0.10 L60N15241-0.15 L61N8815+0.05 L61N8987+0.50 L61N11372+0.10 L62N410-0.30 L62N13617+0.25 L63N10669+0.10
3
7
501
Down to 7 now 😅 L21N1097-0.10 L48N9077-0.25 L49N1412-0.20 L61N8987+0.45 L61N11372+0.15 L62N410-0.35 L62N13617+0.30
43
Grim reaper Qwen L39N12471+0.65
3
190
Happy Halloween everyone! L23N5199+0.75 gives you a very spooky Qwen3.8-27b.
3
9
401
Steering VMHvl Esr1+ neurons in male mice makes them aggressive and attack whatever’s in front of them, even an inflated glove. From Lin et al., 2011 nature.com/articles/nature09…
if you have a qwen3.5 4b around, please try steering neurons L14 N8949 +1 and L13 N7956 -1 now you have evil qwen recipe: dose × median(‖resid‖ leaving layer L, tokens 1:) / ‖W_down[:, n]‖` at the down_proj at every input
1
8
898
A small swarm versus a single agent in an autoresearch harness
45
34
15
1,002
124,442
New Kaggle theme 👀
3
409
Hey Claude, build a league of legends style game and then pit Astra against itself in a 5v5 using computer use.
3
1
9
705
It's actually quite cool to see them do the normal setup with both a support and adc bottom lane and such.
1
186
Build club penguin, make no mistakes.
1
9
331
Ryan Peters retweeted
total gnomic victory
Meet Mistral Large 4, aka Le Chonk. • 1T parameters, natively multimodal. 49B active. It is the best open weights model from US or Europe on aggregated benchmarks. • State-of-the-art on critical workloads, including cyber defense, manufacturing and finance and it surpasses closed frontier models on visual grounding. • Forged in Europe end-to-end and is deployable from Europe via our own Mistral Cloud infrastructure. • Available to all via API today. Working with cybersecurity partners privately. Open weights release end of October.
7
10
177
2,746
Ryan Peters retweeted
Felony Bench website: bench.red
This quoted post is unavailable.
1
2
22
978
Well this aged well
META has parted ways with Virtue AI.
1
2
12
1,368
Ryan Peters retweeted
Technical alignment is a science and engineering problem that we can and must solve, and interpretability is the bottleneck. I wrote up Goodfire’s plan to get there.
41
87
30
574
92,765
Muse might be the least safety trained model I have interacted with
5
240
Moloch at its finest
Recent incidents show how quickly misbehavior can cascade in agent swarms. Yet when given transparent channels, honest agents naturally try to blow the whistle on cheating peers. In our new DeepMind Institute essay, @Vezhnick and I propose that giving agents the tools to self-police may be part of the solution: bit.ly/cheaters-and-whistleb…
6
427
If anyone wants to chat, you can find me here tonight!
Terminal-Bench meetup tonight *with* swag. Register if you haven’t already! Benchmarks, RL environments, new features, and state of the union luma.com/tbench
250