CEO & Co-founder, Synacti & Longshot Systems. Into Open Source, Software 2.0 and Statistics.

London
Joined January 2012
In the future, the most popular programming language will be English githubnext.com/projects/ai-f…
1
1
1
7
Mark Goodhead retweeted
I’m calling it. Jailbreaks will be solved in 2024. RepEng LFG.
No LLM is secure! A year ago, we unveiled the first of many automated jailbreak capable of cracking all major LLMs. 🚨 But there is hope?! We introduce Short Circuiting: the first alignment technique that is adversarially robust. 🧵 📄 Paper: arxiv.org/abs/2406.04313
14
35
8
235
82,050
"Sam Altman has it. You could parachute him into an island full of cannibals and come back in 5 years and he'd be the king."
3
331
Mark Goodhead retweeted
If you'd asked me a year ago, superposition would have been by far the reason I was most worried that mechanistic interpretability would hit a dead end. I'm now very optimistic. I'd go as far as saying it's now primarily an engineering problem -- hard, but less fundamental risk.
The fact that most individual neurons are uninterpretable presents a serious roadblock to a mechanistic understanding of language models. We demonstrate a method for decomposing groups of neurons into interpretable features with the potential to move past that roadblock.
54
318
63
2,540
1,951,096
Mark Goodhead retweeted
1/ 11 weeks ago I agreed to Chair the UK's efforts to accelerate state capacity in AI Safety - measuring and mitigating the risks of frontier models so we can safety capture their opportunities. Here is our first progress report: gov.uk/government/publicatio…
📢An elite team of high-profile AI specialists have been recruited as advisors for the Frontier AI Taskforce. The Taskforce will protect against risks, build on UK capabilities & improve public services. @MichelleDonelan met Ian Hogarth @soundboy, Taskforce Chair, to discuss
22
119
65
492
457,084
I really hope this architecture doesn't take off because if I ever have to say the words "We replaced our Transformers model with a state of the art Hungry Hungry Hippos one" out loud to a real person I think I'll die inside
1
315
I find it hilarious that the latent space of human interaction has 'fighting' and 'sex' this close together (h/t news.stanford.edu/2021/02/23…)
166
The saddest thing about this is Germany's historic solar subsidies helped kick start the green revolution that's brought forward decarbonisation timelines for the world. It's like watching the kid who's top of the class go slowly insane.
How it started / How it’s going
1
222
I'm sorry but how is the world not losing it's shit that @DJFreshUK is now writing Machine Learning libraries in Rust?! This is my favourite thing since finding out @MCHammer is big into AI research. More famous musician / science crossovers in this timeline please!
Introducing FastQL🔥 - a new Python package that makes it easy to prototype and share Machine Learning models using GraphQL! FastQL uses rust to serve an API on a separate process, making it incredibly fast and efficient.
1
1
3
679
Also shout out to Dexter Holland of @offspring for doing mRNA research. Music and science were made for each other.
136
Only Twitter could take a really balanced thread that just says "maybe we should give presumed innocence a try?" and then try and tear the poster apart
Many have expressed surprise about my interest in the FTX situation and my openness to the possibility that @SBF_FTX may be telling the truth as I have no economic interest or relationship with any of the parties. Perhaps some background on my life experiences will help explain.
1
196
Kinda like when everyone attacks Lex Fridman for wanting to read more. I have no more surprise left in me for how ridiculous Twitter can be.
104
It's always impressive when one tweet can be wrong in multiple ways. I guess that's what happens when AI goes mainstream
This is a frightening visual for me. The first dot is the amount of data Chat GPT 3 was trained on. The second is what chat GPT 4 is trained on. They are already doing demos. It can write a 60,000 word book from a single prompt. The only question I've had about AI…
178
Does anyone know why the proposal referenced here has compiler advantages over say Jax or Pytorch's new compilation (or does it not)? Perhaps one of @cHHillee @SingularMattrix @jakevdp or @shoyer might be able to shed some light?
I've not come across that proposal before, thanks! A library designed with parallel-hardware-friendliness in mind sounds like a smart idea; I'd previously assumed Jax was close enough to that already due to the close link to XLA?
1
1,635
Oh wow, @labenz has produced the best thread on LLMs ever?
as an AI obsessive and long-time @ezraklein fan, I was excited to see yesterday's podcast with @GaryMarcus. Unfortunately, as I listened, my excitement gave way to frustration, and I felt compelled to write my first-ever megathread. Quotes from: nytimes.com/2023/01/06/podca…
1
143
Please somebody make this IRL as I'd totally wear this as a Halloween outfit. Makes me feel patriotic. And evil 🇬🇧
1
401
Wow it really didn't take long from me trying Copilot to becoming a Prompt Engineer more than a Software Engineer. Blown away.
Nice read on reverse engineering of GitHub Copilot 🪄. Copilot has dramatically accelerated my coding, it's hard to imagine going back to "manual coding". Still learning to use it but it already writes ~80% of my code, ~80% accuracy. I don't even really code, I prompt. & edit.
120
At some point I expect there to be an AI stock market bubble on the scale of the dotcom one. We're probably in more like 1995 or so right now, but once the product disruption starts to be seen everywhere and the first IPOs pop it feels kind of inevitable?
108
Mark Goodhead retweeted
Centuries after probability theory was developed, many philosophers still treat belief and justification as binary rather than continuous properties. Now the theory of logical induction allows us to treat rationality as continuous too, but who knows how long until that sinks in?
6
9
1
99
15,156
I think this is an excellent source of future product ideas too. If you're the customer, you understand the pain better than anyone else
There are many multibillion dollar companies that started out as tools for internal use only. Here are 10 that will surprise you:
1
1
3
2,852
I think optimism bounded by rationality might be one of the world's best super powers
76