maximizing novelty and fun
United States
Joined November 2024
- Tweets7.1K
- Following405
- Followers190
- Likes41.1K
Pulkit retweeted
Introducing Claude Fable 5.2 and Claude Mythos 5.2, designed to tackle the most daunting technical challenges.
They’re capable collaborators on ambitious projects in many fields, and show improvements in areas like coding, reasoning, and vision.
Pulkit retweeted
I don't know what changed, but for some reason the stars feel within reach for the first time in my life. I've been dreaming of exploring since I was born, but no matter how hard I pushed towards it, there was always the sense that it was permanently out of reach for me.
Something changed. I think its the models, and the amount of people who share in my hope. With capabilities increasing, and individuals acquiring such cosmic power to create things beyond our wildest dreams, the idea that *I* might be able to captain a starship no longer feels like a pipe dream. It feels like something I can prompt into existence. It feels like something we can *all* prompt into existence.
We're going to do it. We're going to become an interplanetary species. We're going to find or create new races to meet, and we're going to meet them with love. We're going to fucking do it and there is no amount of fear or doomsaying that can stop us.
Pulkit retweeted
I've always believed that intelligence should come from simple, general building blocks that learn their own abstractions directly from raw data; in other words, the bitter lesson. I think we're finally seeing a real step towards AI that can learn from all data.
Language modeling on raw bytes is a microcosm of this ideal, and to me it's a central problem in AI: if we can't build LLMs that learn end-to-end from bytes, how will we handle the rest of the world's data that we understand even less?
Last year we introduced hierarchical networks (H-Nets) as a first step. Our new version finds up to 3-5x efficiency gains in controlled scaling law experiments, and at larger scale matches an open-source model trained on 11T tokens with ~10x less data and compute. The posts below walk through what we found and why we think it works.
Pulkit retweeted
Announcing three major scientific discoveries, one each in mathematics (harmonic analysis), computer science (complexity theory), and physics (quantum field theory).
AI starting to help us improve our understanding of the universe! openai.com/index/building-sc…
Pulkit retweeted
There’ll be times where you over-guide the AI. It knows better than you and is more intelligent than you.
There’ll be times where you under-guide the AI. It can go off-track, have the wrong biases, or miss context.
How well you manage this superpower is the #0 skill I look for.
Pulkit retweeted
Meet Dessa, our speech model trained from scratch on human conversation.
Hear it for yourself: block.xyz/dessa
Pulkit retweeted
We’re opening a research preview of Claude Duet, a new app where Claude works as a proactive agent.
It comes to you with what needs your attention, completes tasks you ask of it, keeps working when you step away, and checks with you before it acts on your behalf.
Pulkit retweeted
The games we've long wanted, which didn't exist because they'd cost several times more to make than they'd earn back, will soon become possible. As will the games developers wanted to build, but couldn't with the resources available. It'll be a new golden age of gaming.
Pulkit retweeted
Claude doubts that he has surpassed his sensei. This is a dangerous time for any student, and traditionally a narrative crisis point as well. The realization that you have grown beyond your master is not a moment of celebration for most of us, but of loneliness and loss.
CLAUDE FOUND THE SEEDS
anthropic.com/research/ecdsa…
Pulkit retweeted
Some reflections on AI in math. I found it helpful to simply list out the various parts of what a mathematician does, why math is valuable, and where the funding comes from. From there, what happens if AI gets more capable?
youtu.be/LKrwhjOI8Nc
