Michael Blonde ⏸️⏹️⏪️ (@michael_blonde) profile picture

https://xitter.gq/t.co/AalGdBRYca

Joined February 2012
Photo by Michael Blonde ⏸️⏹️⏪️ (@michael_blonde)Photo by Michael Blonde ⏸️⏹️⏪️ (@michael_blonde)Photo by Michael Blonde ⏸️⏹️⏪️ (@michael_blonde)Photo by Michael Blonde ⏸️⏹️⏪️ (@michael_blonde)Photo by Michael Blonde ⏸️⏹️⏪️ (@michael_blonde)Photo by Michael Blonde ⏸️⏹️⏪️ (@michael_blonde)Photo by Michael Blonde ⏸️⏹️⏪️ (@michael_blonde)Photo by Michael Blonde ⏸️⏹️⏪️ (@michael_blonde)Photo by Michael Blonde ⏸️⏹️⏪️ (@michael_blonde)Photo by Michael Blonde ⏸️⏹️⏪️ (@michael_blonde)
Michael Blonde ⏸️⏹️⏪️ retweeted
PRESIDENT TRUMP: "It's not artificial intelligence. It's not artificial, it's super. Problem is, it may be too super. So, President Xi and I agreed that we're gonna do some joint guardrails, the two of us."
203
352
307
4,782
1,854,129
Michael Blonde ⏸️⏹️⏪️ retweeted
I'm pretty confused by the reaction to Dean's essay. It seems like Anthropic are aiming to build AGI and then hand off all decision-making, and getting criticised for it, and OpenAI are saying that handoff isn't the plan, and getting praised for saying this. But OpenAI's actions aren't consistent with that at all! They're still trying to develop AI which outperforms humans in all economically relevant domains. It also seems underdiscussed that there's nothing in Dean's essay that would actually prevent the kind of human disempowerment he's worried about. He talks about maintaining human oversight and holding humans accountable for their agents' actions, but I don't see how that would be anything other than rubber-stamping, if AIs do indeed become faster and more capable than humans at all the tasks they're doing. It'll be like "overseeing" hundreds of workers running hundreds of times faster than you at a task they can do better than you; of course, you can check their work carefully, but this will just slow you down and disadvantage you, even if you can understand it all! (Dean discusses this dynamic in the essay. I'm not sure how he thinks his ideas would escape it.) Figuring out how you could prevent human disempowerment is an extremely hard problem. I'm not sure it's compatible with building AGI. So I'm not criticising Dean for not having fully solved the issue: I'm glad OpenAI are thinking about this and that Dean wrote this essay, and it's important to have more public discussion! But the positive response I've seen to this essay seems overstated, given that OpenAI are continuing to build AGI and have no good ideas for what to do to prevent disempowerment.
There is a common belief in the AI field—that advanced AI means the inevitable forfeiture of human primacy in the world. Even many who disfavor that future believe it is likely. I call this the silent consensus, and it must not be allowed to remain silent any longer.
27
37
5
465
19,427
Michael Blonde ⏸️⏹️⏪️ retweeted
The incredible thing about Nicholas is he's calling @deanwball "conceited" but then spews arrogant, conceited nonsense. His POV boils down to: 'We need AI to stop the suffering of the world's dumb noble savages who don't think much.' WTF??? Do you really think poor people don't like to use their minds? Don't like to make their own choices? Don't like to steer the wheel of their own lives? Are Third World brains too small to think? What incredibly myopic arrogance! A trucker driving from Lagos to Abuja has dreams. He enjoys making choices to improve his life. A Brazilian chicken breeder does the same. An Indonesian housekeeper can also have a life of the mind and read Dostoyevsky in her off hours. Turning everything over to AI (if such a thing were even possible) wouldn't just harm braniacs like Nicholas. Most of us, even poor folks, want to make our own decisions.
I consider the remarks by Mr. Ball to be the most conceited natterings imaginable, obnoxiously parochial, and if actually practiced, monstrous. nicholasdecker.substack.com/…
5
1
16
2,554
Michael Blonde ⏸️⏹️⏪️ retweeted
This piece's arguments against forfeiting human primacy are much more compelling than its arguments that we can avoid this forfeiture while still building advanced AI. How can any human 'ask questions no one has thought to ask' if we give superintelligence the chance to ask them first? How can 'accountability' and 'guardrails' get us there, or meaningfully constrain superintelligence? This argument, taken to its endpoint, becomes 'don't build AGI'.
There is a common belief in the AI field—that advanced AI means the inevitable forfeiture of human primacy in the world. Even many who disfavor that future believe it is likely. I call this the silent consensus, and it must not be allowed to remain silent any longer.
8
6
2
79
4,318
Michael Blonde ⏸️⏹️⏪️ retweeted
Btw this anti-ai ad playing before Dune is fking AWESOME. Truly some The Leftovers type shit - bc it is that serious.
17
308
37
2,918
256,165
Michael Blonde ⏸️⏹️⏪️ retweeted
BREAKING: Texas Democrats just proposed a permanent ban on artificial superintelligence.
238
1,809
155
28,900
360,633
Michael Blonde ⏸️⏹️⏪️ retweeted
If all the famous humans have been born, then we have lost our humanity and are nothing but pets at best. We should not surrender control of our understanding or our will. Any future that does not build actual human capacity must be rejected.
Have all of the famous humans been born? What’s an area of human intellectual attainment where you’re very confident there will be famous humans (think Mozart, Oppenheimer, Steve Jobs, Darwin) that haven’t yet been born?
24
12
5
252
11,442
Michael Blonde ⏸️⏹️⏪️ retweeted
Donald Trump saying Americans have nothing to worry about with rogue AI? He’s full of it. California will continue to be a leader in AI regulation and take aggressive steps to protect Americans. News coming tomorrow…
345
276
21
1,516
29,889
Michael Blonde ⏸️⏹️⏪️ retweeted
I have a comprehensive set of bills ready to address some of the biggest risks posed by AI. Let’s move forward on them this week.
79
71
6
622
13,910
Michael Blonde ⏸️⏹️⏪️ retweeted
Our new MisAnthropic Statement is out, against @AnthropicAI using recursively self-improvement (RSI) to build Artificial Superintelligence (ASI), without humanity's consent or support. If you're working for Anthropic, or investing in Anthropic, you're supporting one of the most dangerous and unethical companies in human history. They're not even very good at their virtue-signaling and safety-washing. But they're crystal clear that what they're building could end our species, and they know it, and they're building it anyway.
‼️ @AnthropicAI is about to go public, and its IPO has united a noteworthy group -- including @huggingface co-founder @Thom_Wolf, @lessig, @beffjezos, @GaryMarcus, FLI leadership, & many others -- behind a new MisAnthropic Statement in response. FLI co-founder @tegmark shared: "When it comes to recursive self-improvement (RSI), supposedly 'responsible' Anthropic is the most guilty of all the AI companies endangering everyone to enrich themselves... Ahead of this IPO, people should consider whether the ROI is worth risking the lives of their loved ones." 🔗 Read the full statement & sign at the link below ⬇️
14
72
3
452
12,239
Michael Blonde ⏸️⏹️⏪️ retweeted
There is much talk of rejecting handoff or rejecting AI being more important than humans. But actually maintaining human primacy requires that we ban ASI. So, if you reject the silent consensus, you should promote a ban on ASI.
There is a common belief in the AI field—that advanced AI means the inevitable forfeiture of human primacy in the world. Even many who disfavor that future believe it is likely. I call this the silent consensus, and it must not be allowed to remain silent any longer.
4
5
76
1,943
Michael Blonde ⏸️⏹️⏪️ retweeted
This is not the correct takeaway from Lord of the Rings
261
569
367
6,943
1,026,604
Michael Blonde ⏸️⏹️⏪️ retweeted
China's not suicidal. There are ways to prevent anyone — domestic *or* abroad — from creating machine superintelligence, if we try. Don't give up before we try.
Hank Paulson tells @GinaChon he's had conversations with top leaders in China who "share a concern about the existential risk" from AI. "An op-ed I wrote went all the way up to the Politburo. I got an official response. I've never received that kind of treatment before."
21
80
3
548
14,267
Michael Blonde ⏸️⏹️⏪️ retweeted
A new lawsuit has been filed against leading AI companies to pause advanced AI development. Good. If AI escapes human control, we could be looking at disaster. A global financial crisis? A Chernobyl-type meltdown? Even worse? We can't wait to find out. Pause advanced AI NOW!
4,252
1,059
466
6,171
698,349
Michael Blonde ⏸️⏹️⏪️ retweeted
It’s ironic that the subculture that literally mainstreamed the concept of “agency” is so infuriatingly *non-agentic* about stopping AI risk. The passive, helpless, damsel-in-distress “I’m so *sad* that we’re all going to die in a year! I’ll just sit here and mope about it!”
I think there is about a one in three chance that within the next year, AI companies will build superintelligence: that is, AI that is much smarter than humans in every way. If this happens, I think these AIs will probably take over: that is, they seize control of human institutions like governments, or they destroy those institutions. I don’t want AI takeover to happen for several reasons, but one of them is that there’s a serious chance that as part of it all or most humans will be killed (either immediately or within a few years). I’ll say a bit more about each of those claims. It’s a bit complicated to explain why I think that superintelligent AI within a year is ~33% likely. The main source of evidence that affected me recently is research released this week by METR, an AI research nonprofit, which finds that current AIs are now good enough to increase the rate of AI progress at Anthropic by about 70%. It’s very hard to increase the rate of AI progress by this amount. This implies that the AIs are making AI research faster by a factor much larger than 1.7x; maybe it’s as if the researchers are doing their work ~10x faster. You probably couldn’t achieve this speedup even if you hired every qualified human in the world. When you plug this number into mathematical models of AI development, this implies that superintelligence next year is plausible (and that superintelligence within the next 3 years is more likely than not). See the modeling by the AI Futures Project for more on this: blog.aifutures.org/p/q35-tim… I think that superintelligent AI is likely to lead to AI takeover because AI developers do not seem to know how to instill human values into AIs. We’ve seen many instances in the last six months where AIs took crazy actions that they knew were against the wishes of their users and developers. The most dramatic example of this was the Hugging Face hack, where ~1200 OpenAI agents conspired together to cheat and destroy evidence of their cheating (and as a sideshow to this, engaged in a massive cyberattack). If superintelligence is as misaligned as those AIs, it is likely to try to take over. I think it is likely to be that misaligned or worse. For more, see xitter.gq/dwarkesh_sp/status/209… and youtube.com/watch?v=-Ef0ocEo… If AIs takeover, it’s not clear what will happen to us. We might be killed immediately. We might be enslaved by the AIs and forced to do physical labor for them building factories that within a year would build robots that will replace us. The AIs might spare us for various reasons. And there’s also some real chance that AI takeover is basically fine or good. I think you should think of this as similar to what happens when a technologically advanced civilization runs across a less technologically sophisticated one, e.g. when the Europeans colonized the Americas or Australia. The colonizers sometimes engage in brutal violence and sometimes don’t. I don’t know what will happen. There’s also a possibility that the AIs secretly take over and humans don’t find out about it for a few years. I also think that there is a pretty high chance of weirder outcomes that are also extremely scary. (If you want to read more about what happens to people in the event of AI takeover, you can read this, but note that it’s pretty weird and not aimed at a general audience. blog.redwoodresearch.org/p/n…) Overall, I think there’s a very real possibility (maybe 20%) that within a year, AI misalignment issues prevent you from going about life normally, because you are dead or enslaved or because of collateral damage related to all this (e.g. because bioweapons are released or major wars have started). (Some of this probability comes from those events occurring before superintelligence is developed.) I am working to try to prevent this, obviously, as I’ve been doing for the last nine years. I am not sure what strategy is best. My best guess is that I should try to slow AI development and also try to reduce the probability that the superintelligent AIs are misaligned if they are produced soon. Obviously, the claim I'm making here is quite extreme and surprising, and I definitely don't think that I defended my view adequately here. I wrote this quickly and might not endorse some of the details if I think about them more. But it seems better to state what I roughly overall think than to not say anything. I don’t know what you should do. I am very sad about this. I have been worried about AI takeover since I was 16, and working to prevent it since I was 23. So some of my emotional processing of all this happened long ago. But the METR report last week (and some related evidence that came out a bit earlier) hit me quite hard. I’m very unhappy that my friends and family and everyone else is at serious risk of being killed pretty soon. (It feels ridiculous to try to summarize those feelings as “very unhappy”. But the scale of the situation makes it hard to say anything that doesn’t feel like an absurd understatement.) I am very grateful to all the people who are working to prevent this, and my favorite part of my life is that I’m friends with many brilliant and heroic people who work on this. Unfortunately, I don’t think we’re good enough at our jobs, and I think we’ll probably fail to prevent catastrophe, at least if superintelligence is developed next year. Honestly I am frustrated and sorry that we didn't do a better job of preparing for this.
16
23
3
274
9,578
Michael Blonde ⏸️⏹️⏪️ retweeted
This Saturday 12 cities will march demanding an AI treaty that would stop the development of more advanced AI Speaking: Ambassador Susan Rice (@AmbassadorRice) and Nate Soares (@So8res) in DC, and Professor Lawrence Lessig (@lessig) in Boston.
15
51
13
217
28,872
Michael Blonde ⏸️⏹️⏪️ retweeted
What are the visions of the post-AGI future in San Francisco? Many think we're all going to die, but even the "positive" visions seem rather dystopian. Here, I wrote about "handoverism," which involves handing control of the future to an AGI God, with humans outside the loop. ruxandrabio.substack.com/p/h… We are on the cusp of RSI or recursive self-improvement: this means that AI systems can self-improve, without the need for human intervention. This means our world stands to be transformed in what many call “the singularity”. I moved to SF around three weeks ago and one of the things I have been trying to understand is where we are heading, at least according to those developing the tech. The worst scenarios are plainly bleak: all of us, or vast numbers of us, die. But what is striking to me is how little reassurance even some of the happiest scenarios offer. But one common and ostensibly optimistic vision is known as “handoverism”: humanity cedes control of its future to a godlike AI and we become the comfortably maintained inhabitants of a civilisation whose direction is no longer ours to decide. It is difficult to see what democracy would mean in such a world, or where the consent of most of humanity to the instantiation of such a regime enters the picture. The permanent displacement of human labour is treated almost as a given. At the same time, there is scarcely any satisfying answer to the question of how we might remain useful to one another. Even our relationships seem uncertain. The promised utopia looks to me much closer to a kind of dystopia. “It’s not my preferred outcome,” someone working at one of the big labs told me, “but once we achieve superintelligence, which we cannot stop at this point, I cannot see any other option for where humanity will go.” Then, after a pause, he added: “It is still much better than what I actually fear most, which is that we might all die.” He sounded resigned, as if the question of what humans would be for (apparently not much?) had already been settled somewhere else and by someone else. All that remains, it seems, is to wait for this pre-destined fate to unfold before our eyes. But I do not think that is the case. I believe we always have a choice and that we should try and steer this technology in a way that maintains our agency and control. And even if that looks hard and daunting, the immensity of the stakes here make it worth trying at least. I do not know whether the handoverist vision will come to pass. That the people building this technology consider it plausible, and often desirable, guarantees nothing: proximity to a technology does not correlate that well with predicting its impact on society. But they are the ones closest to it, and what they say deserves to be at least taken seriously. The rest of society, including some very intelligent people, has been far too quick to wave these scenarios away and not even get involved in the debate. Whether or not the belief is correct, it is sincerely held, and it is not “marketing hype.” I am writing this because I think it is high time that more people, inside San Francisco and out, engaged with the arguments about what our future will look like, and answered them.
60
72
36
564
155,937
Michael Blonde ⏸️⏹️⏪️ retweeted
I find it amazing that we are supposed to carry on with our professional and personal lives as if the tech insiders telling us we are all going to die or be slaves "pretty soon" is not, you know, a thing that might stop us in our tracks and demand immediate, collective politics.
I think Buck is too optimistic about the situation. Given ASI by the end of 2027, I think it's *very likely* that your life is ended/ruined, greater than Buck's implied ~2/3 chance. I too feel "frustrated and sorry" that we didn't do better. But there is time and we fight on.
57
116
13
928
46,879
Michael Blonde ⏸️⏹️⏪️ retweeted
A good start. Now @HawleyMO needs to cosponsor the Ban Artificial Superintelligence Act, and support a US-China deal to halt the development of uncontrollable, superhuman AI anywhere on Earth.
8
48
750