We help decision-makers navigate the transition to a world with advanced AI, by producing rigorous research and fostering talent.

London, United Kingdom
Joined October 2021
We have a new paper out today: "What if automating AI R&D triggers an intelligence explosion?" led by @_achan96_, with an incredible team of collaborators. casp.ac/reports/intelligence… 🧵
Could automating AI R&D radically accelerate AI progress in an “intelligence explosion”? Preliminary evidence suggests that it could. In a new paper with authors across academia, civil society, and frontier AI companies (including @dawnsongtweets @merettm @jackclarkSF @Yoshua_Bengio @geoffreyhinton ), we assess the evidence & offer policy recommendations 🧵
7
27
1
143
18,451
Join us for our first ever Vision Weekend in the UK! ​2026 marks 40 years of Foresight. Over three days, we will gather leading researchers, builders, and funders to look forward: exploring what scientific and technological frontiers will shape the coming decades, and how to make them reality. June 5–7 | London Confirmed speakers include: • ​Ed Boyden (MIT) on biologically accurate brain simulation • ​​Greg Wayne (Google DeepMind) on universal AI assistants • ​Jano Costard (SPRIND) on challenges as a tool for breakthrough innovation • ​Christine Peterson (Foresight Institute) on Foresight, 40 years later • ​Dorothy Chou (Google DeepMind) on capital for the long game: financing durable innovation in an age of hype • ​Irina Rish (Mila) on beyond scaling: toward continual and adaptive intelligence • ​Chris Rozell (Georgia Tech) on closed-loop neuroengineering: algorithms that learn from the brain in real time • ​Lee Cronin (University of Glasgow) • ​Mehmet Fisek (Meridial) on Focused Research Organisation mission and setup • ​Zoë Brammer (Google DeepMind) on AI for science 2030 • ​João Pedro de Magalhães (University of Birmingham) on hacking aging biology and many more. Get your tickets: foresight.org/events/vision-… Powered by: @apolloresearch @ARIA_research @e184media @CUHPartners @RenPhilanthropy @SPRIND @andnowstudio
6
12
2
39
7,039
There's been intense debate about AI and lone-wolf bioterrorism. How worried should we actually be? My new report tackles this question—investigating the threat model, why experts disagree, and proposing a concrete framework for risk assessment.
10
22
5
107
8,323
Ever wondered what to think of AI safety policies or 'escape clauses' that are based on marginal risk relative to competitors? We explore this topic in our newest policy brief, led by the wonderful @_S_Williams, and argue that this particular approach to marginal risk is problematic. Read the brief: cdn.governance.ai/Assessing_…
1
3
17
2,872
Frontier AI companies increasingly assess how much their models increase risk compared to competitors’ models. In our new policy brief, we argue that this particular approach to marginal risk is problematic. 🔗 Learn more: cdn.governance.ai/Assessing_…
3
11
5
32
13,664
📢 Job Opportunity: @GovAI_ is looking for a General Counsel. 📍 Location: London or US 💵 Salary: $150,000–$195,000 + benefits 📅 Deadline: October 26, 2025 🔗 Learn more: governance.ai/post/general-c…
3
8
1,742
Really excited to release this new paper on AI benefit sharing! I think this topic -- ensuring that the economic and societal benefits of advanced AI are widely accessible internationally -- is going to be an increasingly important challenge as AI advancements continue.
4
20
3
56
7,875
🌐 New @GovAI_ Report on international AI benefit sharing! Many actors are increasingly invested in shaping the international diffusion of AI technologies and benefits. We map the various motivations and options on the table, as well as their strategic implications. 🧵 (1/19)
2
13
1
33
4,214
Today, we are publishing the first-ever International AI Safety Report, backed by 30 countries and the OECD, UN, and EU. It summarises the state of the science on AI capabilities and risks, and how to mitigate those risks. 🧵 Link to full Report: assets.publishing.service.go… 1/16
50
507
140
1,352
403,102
1/ What does the public think about AI, from its impact on jobs to how we should govern it? We explore this in a new report by @lawhsw, @chloeahn1016, @Dan_Schiff, @kaylynjackson, @zpeskowitz, and myself - a @GovAI_ & GRAIL lab @purduepolsci collaboration.
3
12
3
26
4,641
Whether 2025/6/7/8/etc is the year of AI agents, we will need tools to help us unlock their benefits and manage their risks. Our new research agenda proposes agent infrastructure as an answer to this challenge 🧵
7
31
13
163
29,588
What can engineers and scientists do to assist AI governance efforts? In collaboration with @GovAI_ and @SISLaboratory, researchers outline the field of Technical AI Governance. Read more: oxfordmartin.ox.ac.uk/public…
5
18
2,480
Excited to share our new website on Open Problems in Technical AI Governance, a companion to our recent paper on the topic! Check out the website here → taig.stanford.edu ← and see the thread below for more details. Huge thanks to @AnkaReuel for putting this together!
1
12
60
4,661
GovAI retweeted
AI Security Institute (AISI)
@AISecurityInst19 Sep 2024
📢 We're hosting a conference in November on frontier AI safety commitments. With @GovAI_, we'll bring together AI companies and researchers from all over the world in San Francisco to discuss the safer development of AI.
2
18
8
79
26,913
Regulators in the US and EU are using training compute thresholds to identify general-purpose AI models that may pose risks. But why are they using them if training compute is only a crude proxy of risk? In “Training Compute Thresholds: Features and Functions,” we argue why. 1/
5
23
5
83
10,782
📢 Applications for the @GovAI_ Winter Fellowship 2025 are now open! More below 👇
1
19
1
61
8,516
Excellent analysis by my @GovAI_ colleague @sj_manning on AI's potential impact on income inequality. Insightful interpretation of recent evidence and long-term inequality risks: brookings.edu/articles/ais-i… A must-read for anyone interested in the economic effects of AI!
What will the impact of AI be on income inequality in the US? I wrote a piece for @BrookingsInst exploring what recent evidence tells us and how things could change as AI continues to advance. brookings.edu/articles/ais-i…
4
28
4,289
AI will drive economic growth. It will also disrupt labor markets. These effects could be large and they could unfold pretty quickly. I think it would be nice if policymakers had better foresight into these impacts, so I wrote about ways we can generate better evidence. 🧵
3
14
45
8,682
Excited to see "GPTs are GPTs," co-authored by my colleague @sj_manning, out in Science today! I think it's an important step forward in our ability to understand the economic significance of general-purpose AI. science.org/doi/10.1126/scie…
1
11
42
4,636
📢 We're hiring! The Centre for the Governance of AI (@GovAI_) is looking for Research Fellows and Research Scholars! governance.ai/opportunities More below 👇
4
47
1
153
25,127