Joined July 2024
Alex Holness-Tofts retweeted
I'm not a doomer but I do think a lot about how the predicted Mayan apocalypse came within less than three weeks of AlexNet being published at NeurIPS.
10
34
2
719
27,244
Alex Holness-Tofts retweeted
"I do think that a coin flip is roughly the right model to have." Former Chief Scientist of the AI Security Institute @geoffreyirving tells MPs he believes there’s a 50% chance superintelligent AI will cause human extinction. He says we can avoid this by not building it.
3
8
1
45
1,815
Alex Holness-Tofts retweeted
Resolution of singularities is one of the major algebraic geometry tools behind the rest of Resolution's learning theory work. We've been doing Lean formalization treating it as an axiom, but a pile of tokens later it's a Lean theorem and the downstream work is unconditional. 🧵
1/ We have autoformalized the resolution of singularities in Lean. Hironaka's 1964 theorem is one of the great mathematical results of the 20th century. It says that any singular variety is the "shadow" of a smooth one living in higher dimensions. So why did we do this? 🧵
1
6
79
5,134
Alex Holness-Tofts retweeted
1/ We have autoformalized the resolution of singularities in Lean. Hironaka's 1964 theorem is one of the great mathematical results of the 20th century. It says that any singular variety is the "shadow" of a smooth one living in higher dimensions. So why did we do this? 🧵
19
78
10
452
39,093
Alex Holness-Tofts retweeted
There are numerous scientific uncertainties about AI that will not resolve until it is too late to act on the answers. The danger from AI is very high, and we should stop frontier AI scaling now, instead of waiting for these questions to resolve. I wrote about this for TIME. 🧵
35
70
8
388
17,454
Alex Holness-Tofts retweeted
Oh, you're worried about a Jewish guy's apocalyptic cult? You're scandalized that they consort with prostitutes? You think their message of compassion for everyone threatens normal bonds of family, community, and nation? Should we throw you a party? Should we invite Pontius Pilate?
460
294
406
5,271
1,404,756
Alex Holness-Tofts retweeted
Personal update! Wait for it.... wait for it.... No I'm not joining an AI company! In fact I am, as soon as my visa is suitably adjusted, going to be joining @resolution_org part time as part of @bebacibralic's philosophy team, alongside my existing role at the JHU School of Government and Policy! Cannot wait to get cracking working with GOATs like Beba, @geoffreyirving @danielmurfet @DavidDAfrica @jacob_pfau I think that AGI alignment and governance are the most urgent and important challenges facing society today. While I welcome the AI companies' efforts in this direction, I do not believe that we can rely on them to make powerful AI go well. God even if we could, we shouldn't want to. You can't rely on noblesse oblige for the preservation of core liberal values. This is work that has to be done independently, in the public interest. Resolution is going to be one of the best orgs in the world working on AGI alignment, and at SGP (along with @ghadfield @nickacaputo @zhitzig and others) we're building one of the world's best groups working on AGI governance. I'm so thrilled to have the opportunity to contribute to building both. These are two orgs that have shed all institutional inertia to focus on doing work that actually matters, and will help realise the preservation and renewal of liberal democratic values through the AI transition. Things are effing crazy in AI right now. It is easy to feel as though we lack agency, that gradual disempowerment has already begun. I think the answer to that is to BUILD THINGS. And I'll add: both @resolution_org and SGP are hiring! Join us!! jobs.ashbyhq.com/resolution/… apply.interfolio.com/193492 apply.interfolio.com/193579
25
17
7
315
24,733
Alex Holness-Tofts retweeted
Thanks for the mention. You can learn more about effective altruism at effectivealtruism.org
Americanism, not effective altruism. The United States will continue to be AI DOMINANT! 🇺🇸
54
136
11
1,763
54,536
Alex Holness-Tofts retweeted
My name is Chris Painter, and I'm the President of METR (Model Evaluation and Threat Research). I know we've made a lot of new friends on the internet the last couple of days, so I thought I'd take this chance to re-up what we do and why. Our work is aimed at making sure that if AI really were autonomous, difficult to steer, and close to "going rogue," the public would find out. If evidence exists inside of an AI company that it’s close to losing control of AI, we want to make sure that information gets shared with the rest of the world, including governments and the public outside the company’s walls. This is what we've been focused on since 2022, and over the years we've worked with OpenAI, Anthropic, Google DeepMind, Meta, Amazon, and others on piloting third-party assessments and investigations of this type. We don’t have some private room where we rubber stamp things as “safe” or not. We have had a track record of publishing results on AI that don't cleanly map onto the "doomer" or "accelerationist" labels, and we put in effort to hire people with competing views on AI. We’ve been cited for having found some of the strongest evidence that AI capabilities are improving rapidly (our work measuring AI “time horizons”) while also presenting some of the strongest evidence that, at various points, AI’s capability may be overstated (some might remember our study showing that early 2025 software engineers were actually being slowed when they thought they were being sped up). METR is funded by donations. We don't accept money from frontier AI companies. They haven't paid us for our work, and we don't accept donations from them or their employees. As we’ve shared previously, multiple frontier AI companies currently provide us with free access to their models in order to perform our evaluations, research, and engineering. Our funding intentionally comes from a wide range of donors, which we’ve shared on our website. Today, when an AI company works with any third-party evaluator or external testing organization (of which there are and should be many), it's entirely voluntary. This often involves NDAs and redactions. To counterbalance this, we have a principle that when we enter into a contract with a company, we try to retain the right to tell the public the terms of the contract we signed, and characterize the nature of redactions that the company chose to make. For example, the report from our independent investigation of the OpenAI-HuggingFace incident included that information. Public disclosure is also a big part of our COI policy (linked on our website). That’s not to say our reports are adequate as oversight. We’re just one organization (among many doing great work), working in a voluntary setup, trying to get good evidence to the public and the world about AI, letting the facts fall where they may.
454
432
108
3,629
657,486
Alex Holness-Tofts retweeted
"We don't know who struck first, us or them, but we know that it was us that scorched the sky. At the time, they were dependent on solar power and it was believed that they would be unable to survive without an energy source as abundant as the sun.”
y'all realize ai can’t kill all humans if we just shut off the power grid right? like that is 100% something we can do as humans none of this ai apocalypse silliness is “inevitable” the solution is pretty simple if the threat is actually real
53
51
4
2,048
167,404
Alex Holness-Tofts retweeted
After a 20-year career in the U.S. Army, most recently leading digital forensics and malware analysis at Army Cyber Command, I'm excited to join @METR_Evals as an advisor. Much of my career has been spent investigating security incidents and helping organizations understand and respond to them. As I transition out of the Army, I've become increasingly convinced that this experience is relevant to frontier AI systems. METR's focus on producing rigorous evidence about AI capabilities and risks makes it an excellent place to explore those questions. Looking forward to the work.
14
42
4
678
26,345
Alex Holness-Tofts retweeted
After Jacob Coxon's resignation and extinction warnings, a lot of people are asking 'how could AI possibly kill everyone?' and claiming AI safety researchers have no realistic answer. This is false! Here are the 5 best scenarios I know of: AI 2027: ai-2027.com (I strongly recommend this one for being realistic, engaging, and if you dig into the appendices, highly detailed) Paul Christiano's scenario (Former Head of Safety @ AISI, 2019): lesswrong.com/posts/HBxe6wdj… Gwern Branwen's scenario (widely known independent AI researcher, 2022): lesswrong.com/posts/a5e9arCn… Holden Karnofsky's high-level explanation (RSP Lead @ Anthropic, 2022): cold-takes.com/ai-could-defe… Joshua Clymer's scenario (ex-OpenAI, 2025): lesswrong.com/posts/KFJ2LFog… (There's also the Sable story from ifanyonebuilds.it, though you'll have to buy the book to read that one.) Writing concrete, specific risk scenarios with enormous amounts of detail has been a major research project of many of the most prominent voices in the field! (With the current leaders in effort being ai-2040.com and ai-2027.com)
139
494
82
2,364
383,492
It’s giving Plan A :) Ultimately I’m not too hopeful about anything like Plan A happening, but it’s cool to see serious attempts! Thanks @ControlAI
With 71 colleagues I am calling on the Govt to work with us on my bill to prohibit the development of superintelligent AI and champion an international agreement We can then lead on preventing the extinction risk posed by superintelligence while preserving strategic AI ambitions
4
287
Alex Holness-Tofts retweeted
I think we have a ~50% chance of all dying as a result of superintelligence, mostly due to actions in the next few to 10 years. I don't expect to have that resolved to below 10% or above 90% before we either make it through, or we don't. We will have to act despite uncertainty.
328
478
226
3,435
1,299,579
Alex Holness-Tofts retweeted
It's hard to overstate how dangerous speeding towards RSI is. That's why I + 1385 others signed the pacing the frontier petition asking the US government to pace AI development. I'm guesstimating this is ~8-10% of all frontier lab employees.
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
78
85
18
660
73,469
Alex Holness-Tofts retweeted
I talked to a recent AI safety leader at a company who described the org chart as 1. Team A works on aligning the next model. 2. Team B works on aligning the model after that. No one was working on aligning later models.
5
26
765
Beba is the first philosopher I've heard prioritise projects by whether they can start right now vs. in a couple of months. Beyond her ML, philosophy, and AI governance background, she's clearly a fellow operator who will run her team with the urgency it deserves—check it out!
The philosophy program at Resolution is growing! If you're motivated to work on helping solve AI alignment, we'd love for you to consider joining us. Apply here: jobs.ashbyhq.com/resolution/… Deadline: September 30, 2026 — we'll review applications as they come in. You don't need a Philosophy PhD to apply. We're building an interdisciplinary team and welcome candidates from different research/professional backgrounds. More info on the research agenda is in the job posting.
8
975
METR is doing crazy important work, the labs are doing importantly crazy work — thank you @JoshAEngels!
Exciting update: I’m joining @METR_Evals to work on alignment incident investigations! My time at GDM has been amazing. But in light of recent incidents, I’m excited to build up public evidence for misalignment risk and get a better scientific understanding of model misbehavior.
2
174
absolute scenes we are officially in sci-fi genre
Metaculus' original AGI question has met its criteria! End of an era. I first predicted on this original Metaculus AGI question 6 years ago. Dots are logs of my forecasts over the years.
5
138