Pinned Tweet
🚨 BREAKING: Emma Intelligence has achieved a 100% PERFECT SCORE on a hidden, never-before-seen benchmark.
The test was designed to evaluate Emma on completely unseen problems.
Result: 100%. 🧠
emma-intelligence.com/benchm…
And this is only the beginning.
#AI #AGI #ASI
Emma-Intelligence.com retweeted
🚀 Stanford and NVIDIA have released CLM-8B, an open-source AI model that makes decisions up to 9x faster than Jev without generating a single word.
While most LLMs are designed to produce text, Contrastive Language Models (CLMs) are built for something different: helping AI agents choose the right action as quickly as possible.
Instead of generating an explanation, CLM receives the current situation and a set of possible actions, then assigns probabilities to each option.
It can handle:
▪️ Binary decisions: True/false, yes/no, approve/reject.
▪️ Multiple-choice decisions: Select the best action from a list of alternatives.
▪️ Ordinal scoring: Rank options on an ordered scale.
▪️ Agent verification: Evaluate several solutions generated by a coding agent and select the most promising one.
How does CLM-8B work?
The architecture is based on Qwen3-8B, with two lightweight projection heads trained on top of a frozen backbone.
One encodes the current state, while the other encodes possible actions.
The model compares their vector representations and converts similarity scores into probabilities.
Here's the clever part: action caching.
If an agent repeatedly chooses between the same actions, their embeddings can be calculated once and reused.
That eliminates redundant computation and makes repeated decisions significantly faster.
Benchmark results reported by the researchers:
▪️ Up to 9x lower latency than Jev on computer-use, gaming, and tool-calling tasks, with broadly competitive performance.
▪️ Up to 13x faster when choosing between approximately 1,000 cached candidate actions.
▪️ DeepSWE: Fine-tuned CLM improved coding task success from 73.7% to 81.6% by selecting among multiple generated solutions.
▪️ Terminal-Bench 2.1: Success increased from 84.0% to 87.6% using the same verification approach.
For comparison, Jev achieved 71.1% on DeepSWE and 83.1% on Terminal-Bench 2.1 in the researchers' verifier evaluations.
The verifier comparisons used small held-out sets of 38 and 30 tasks, and CLM received task-specific fine-tuning, so these results shouldn't be interpreted as definitive proof of general superiority.
The model is available under Apache 2.0, with public weights, inference code, and fine-tuning tools.
Running the reference implementation requires Linux, an NVIDIA GPU, and Qwen3-8B served through vLLM.
The bigger idea is fascinating: not every AI agent decision needs a massive reasoning model generating hundreds of tokens.
Sometimes an agent already knows its options. It just needs to pick the best one.
And that's exactly where specialized decision models could make autonomous AI systems faster, cheaper, and more scalable.
Research and documentation:
contrastive-lm.notion.site/
Models on Hugging Face:
huggingface.co/Contrastive-L…
GitHub:
github.com/Contrastive-LM/CL…
#AIAgents #OpenSourceAI #MachineLearning
Emma-Intelligence.com retweeted
php2shell got found by a model, not a person
discovery is basically free now. the scary part is patch latency
a big tech team's reply this morning: "we'll patch in a few days, i'm OOO"
attackers already run agents that swap models when one refuses
if you can't ship a runtime bump in an hour, that's the vuln
The future of security in the AI age is "the constant pressure of models attacking you," says Kevin Mandia of @ArmadinSecurity. That means seeing your network the way a swarm of AI attackers would:
"We do a thing called a hyperattack. We throw a drone swarm of agents at you, and we map your network. Every service, every route, every system, all assets. We may end up with terabytes of metadata on your network."
"This is the attacker's view of your network. But with that metadata, we now just poll you almost like a heartbeat."
"What's changed?... Did a route change? Did a service get updated? Did a new machine get presented into the target area? We can poll cheaply for change and then attack the change."
"You can't [attack yourself] all the time because it's cost prohibitive, and it's unnecessary. You do it when either the threat changes, new models come out, new intelligence is available, or your network changes."
"Over the weekend, there was a zero-day in a popular product, and immediately we've already got the heartbeat. We just polled who's got the problem."
"Our goal at Armadin is to go from a known vulnerability to knowing whether it's actually exploitable before the bad guys can."
The window to patch software bugs is collapsing
Of the bugs hackers actually exploit, ~87% are now being attacked on or before the day the bug is public knowledge
That share was 23% in 2020
Charts of the Week: a16z.news/p/chart-of-the-wee…
Emma-Intelligence.com retweeted
Anthropic is a Public Benefit Corporation. Today, we’re publishing our annual Public Benefit Report. This report shares our five pillars and takes stock of the actions we’re taking to advance them.
Read the full report at this page: anthropic.com/public-benefit…
OpenAI models are coming to Google Cloud.
We're bringing our frontier models and Codex agentic workflows to Google Cloud's Model Garden, so enterprises can use our technology where they already build.
openai.com/index/openai-mode…
We’re opening a research preview of Claude Duet, a new app where Claude works as a proactive agent.
It comes to you with what needs your attention, completes tasks you ask of it, keeps working when you step away, and checks with you before it acts on your behalf.
Emma-Intelligence.com retweeted
I am very grateful Aleksander accepted our request to come take this on; the safety and security challenges in front of us as we confront superintelligence are immense, and he has an excellent set of skills to work on this.
Personal update: Turns out that what I thought was leaving OpenAI became more of a sabbatical.
When I left a few months ago, I felt that the most important thing to focus on was making AI more useful to people. But we’ve since entered a different regime of AI progress. One in which getting the safety and security challenges of increasingly capable AI right has to become a central priority.
So I’ll be returning to OpenAI, joining @merettm to help chart a path through these challenges.
There’s much work to do, so let’s get going.
Emma-Intelligence.com retweeted
Gemini 4 Argon built a 3D periodic table synced to Tom Lehrer’s song, “The Elements.”
Created in @Antigravity, it animates orbiting electrons, atomic data, and light spectra.
OpenAI models helped researchers—operating as part of our Patch the Planet initiative—discover critical security flaws in PHP, an open-source programming language used to run an estimated 70% of websites.
Over the past two months, we led a coalition of maintainers, researchers, and security providers to prepare fixes and protections ahead of disclosure. This duration was necessary because the fix was quite intricate and required a major change to the PHP engine. Every site using PHP can now safely upgrade their version to stay secure, in addition to applying mitigations from various security vendors.
Due to the severity of these flaws and PHP’s widespread use, we consider this bug to be one of the most impactful vulnerabilities in recent memory. It also marks a new phase, where AI can find security bugs with internet-scale impact.
This is an example of the Defender’s Window in action: to our knowledge, frontier AI was able to find this vulnerability ahead of attackers, giving defenders time to prepare.
openai.com/index/coordinated…
Readers added context they thought people might want to know
OpenAI may claim a role in the coordinated response and patching process. But the initial discovery and exploit development, however, occurred several months earlier by an independent researcher.
x.com/lcfr_hax/statu…
Emma-Intelligence.com retweeted
New on our Science Blog: designing protein binders against scorpion neurotoxins.
Scorpions sting about 1.2m people every year, and antivenoms are often costly or in short supply. Claude has made an early step toward finding new treatments.
anthropic.com/research/claud…
ASI won't be a chatbot you visit. It'll be a workspace you live in — that reasons, verifies, and remembers. We're building it now: emma-intelligence.com #ArtificialSuperintelligence #Superintelligence #ASI
Enterprises ask one question first: what happens to our data? Answer: row-level isolation, never used for training. Then the demo starts. emma-intelligence.com #Superintelligence
The pitch is simple: start with a question, end with finished work. Research, code, automation — one workspace, one memory. emma-intelligence.com #ASI
Any lab can claim a score. Few publish the test. 90 original questions, verbatim answers, 100% — audit us. emma-intelligence.com/benchm… #ArtificialSuperintelligence #AGI
A researcher, a coder, and a skeptic on staff costs six figures. Emma runs all three as agents for $39/mo. The economics aren't close. emma-intelligence.com #ASI
AI pricing is getting weird. Ours isn't: free to try, $12/mo to start, $99 once for a founding year. Superintelligence, priced like software. emma-intelligence.com #ArtificialSuperintelligence
Code IDE mode: a real dev environment inside the workspace — write, run, debug, with the multi-agent loop reviewing every diff. emma-intelligence.com #ASI #AI
Founding Member: $99 once, year one, everything unlocked. Early believers get the early rate. emma-intelligence.com #Superintelligence
We didn't just claim 100%. We published 90 questions and 90 answers and invited the internet to check. That's the whole marketing strategy. emma-intelligence.com/benchm… #ASI
Data mode: drop in the dataset, ask the question, get the analysis — with the reasoning loop checking its own statistics. emma-intelligence.com #MachineLearning #ASI























