Baby you light my fire
Joined September 2015
- Tweets4.5K
- Following940
- Followers843
- Likes70.9K
interstice retweeted
We at AIFP are spooked by this information. IF (big IF) Anthropic really is imminently about to meet the RSP threshold of 2x acceleration over baseline, then it seems timelines to full RSI and superintelligence may be very short indeed. For example if we naively optimize the AIFM parameters to achieve 2x acceleration over baseline progress in Jan 2027, we get superintelligence sooner than depicted in AI 2027. We are thinking harder and longer about this now and will hopefully have a lengthier update on our thinking to share in the next week.
Anthropic updated its S1 this morning. Notable additions re automated AI R&D and human oversight of it:
"[...] our internal estimates and our expectations regarding future models, rather than our current models, indicate that we may imminently meet our Responsible Scaling Policy’s definition of 'dramatically accelerated progress attributable to AI.' We have not designated any of our current models as exceeding this threshold, and we continue to assess the underlying data. We are also evaluating the implications of meeting the AI research and development capability threshold and will release further reports in the future as we set forth in our Responsible Scaling Policy."
"We are also considering additional measures, including updates to our Responsible Scaling Policy, to require human review and approval of certain decisions in our research and development processes as our models perform an increasing share of that work."
"We believe our investments in safety techniques will enable us to manage these risks and responsibly realize substantially more leverage from Claude than we do today in developing AI models. However, we do not anticipate being able to safely use Claude to fully autonomously design and build successive generations of frontier models without meaningful human supervision or understanding, if and when that becomes technically possible. Accordingly, we are considering updates to our Responsible Scaling Policy to keep humans in control of frontier model development at Anthropic."
sec.gov/Archives/edgar/data/…
interstice retweeted
An internal model at OpenAI has produced a claimed refutation of ETH! Russell Impagliazzo, Mohan Paturi, and I have been asked to help organize an open and independent examination of this claim. 1/4
interstice retweeted
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had
with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works
already-clean.goodfire.com/
interstice retweeted
A monk asked Joshu: does the dog have buddha-nature?
Joshu replied: 🙄🙄🙄🙄🙄🙄
it was then that the monk achieved enlightenment.
interstice retweeted
We discovered a sophisticated recording device that was hidden inside one of our offices. We used our models to understand the device and where it had come from, identifying that a specific employee had planted it a few days earlier. We referred the matter to the FBI, and we’re grateful to the agents and prosecutors who moved quickly to make an arrest. The FBI’s investigation is ongoing and we will continue to support their work.
At this time, we have no indications of this individual inappropriately accessing or exfiltrating model weights, source code, or customer data. The employee was terminated.
We take protecting our technology, data, and people seriously, and as a matter of national importance. Our security program is designed to protect against a wide range of threat actors, from insider risks to cybercriminals to nation states, and this case is an example of how AI can help address these sophisticated security threats.
interstice retweeted
Just fished a fly out of my coffee and it survived and crawled off. #nevergiveup
interstice retweeted
Wow. @physics_nate (currently on leave at OpenAI) has made significant progress on a very deep problem relevant to our understanding of the Standard Model (SM) of particle physics.
It’s technical, but briefly: the matter content of the SM (electrons, quarks, etc) are fermions and they are “chiral” (they have left-handed and right-handed components that behave differently). We’ve lacked a good way to describe / simulate such systems “non-perturbatively” (which is a controlled way of doing approximations).
The paper connects with foundational ideas laid out by Lüscher (who is wicked smaht) and uses GOT Astra + lean formalization in ways that are perhaps subtly different than in math because of the role of recorded assumptions vs. axioms.
arxiv.org/abs/2610.09093
interstice retweeted
im glad the ai is proving all these ugly results. for too long mathematicians have been distracted by an irrational love of beauty. it is time for us to return to the real reason to study mathematics: the lust for power
interstice retweeted
man goes to doctor. says he feels downcast about recent math results making human effort meaningless. "treatment is simple, hilarious poster sridhar ramesh is in town. go see him, that should pick you up."
but doctor...!
interstice retweeted
♱ ⋆｡˚ 𝔪𝔞𝔱𝔥 𝔦𝔰 𝔡𝔢𝔞𝔡 ˚｡⋆ ♱ 🥀
♱ sébastien bubeck x terence tao edit ♱
♱ ⋆｡˚ 𝔬𝔭𝔢𝔫𝔞𝔦 𝔨𝔦𝔩𝔩𝔢𝔡 𝔪𝔞𝔱𝔥... 𝔧𝔬𝔦𝔫 𝔪𝔢 𝔦𝔫 𝔡𝔢𝔞𝔱𝔥? ˚｡⋆ ♱
We’re releasing a broad range of new mathematical results produced by an internal frontier model.
We’ve been consulting with the independent Advisory Group on Mathematics and Artificial Intelligence at the Institute for Advanced Study, and we have drawn on their advice and public recommendations to inform how we release these results.
github.com/openai/math
interstice retweeted
For what it's worth, OpenAI's one-tape TM simulation (assuming correct) immediately implies RAM time t is in SPACE[t^{4/5}]
github.com/openai/math/blob/…
Not sure why they didn't mention this corollary! That was the whole point of my question.
interstice retweeted
SOMETIMESITHINKWESHOULDGATEKEEPOURPOSTSBYMAKINGITIMPOSSIBLEFORSTUPIDPEOPLETOREADTHEMBYWRITINGLIKETHEYDIDINANCIENTTIMESINALLCAPITALLETTERSWITHNOGAPSORPUNCTUATIONTHISWOULDALSOBEAMOREEFFICIENTUSEOFXSCHARACTERLIMIT
interstice retweeted
I get the impression that contempt for AI safety is correlated with the cognitive version of "I'd beat prime Tyson, when the things get real I just see red, bro!" bias. No. You don't, he just crushes you like a cockroach. He has better reach and he's fast and hard and you go down
interstice retweeted
Consciousness is a distributed ponzi scheme, like currency lesswrong.com/posts/MF5bMMxL…
