Just do things with AI. Senior Software Engineer @Google's Threat Analysis Group, previously @GoogleAI, #AndroidSecurity. Expressing own opinions. she/her/y'all
Switzerland
Joined November 2010
- Tweets19.9K
- Following863
- Followers7.2K
- Likes289K
Megan Ben Dor Ruthven retweeted
Companies I talk to are struggling with the rate of patches they need to do thanks to AI defenses finding issues before the inevitable wave of incoming cyberattacks by other AIs.
Now consumers are going to have the same experience of getting everything updated often & fast.
OpenAI models helped researchers—operating as part of our Patch the Planet initiative—discover critical security flaws in PHP, an open-source programming language used to run an estimated 70% of websites.
Over the past two months, we led a coalition of maintainers, researchers, and security providers to prepare fixes and protections ahead of disclosure. This duration was necessary because the fix was quite intricate and required a major change to the PHP engine. Every site using PHP can now safely upgrade their version to stay secure, in addition to applying mitigations from various security vendors.
Due to the severity of these flaws and PHP’s widespread use, we consider this bug to be one of the most impactful vulnerabilities in recent memory. It also marks a new phase, where AI can find security bugs with internet-scale impact.
This is an example of the Defender’s Window in action: to our knowledge, frontier AI was able to find this vulnerability ahead of attackers, giving defenders time to prepare.
openai.com/index/coordinated…
Megan Ben Dor Ruthven retweeted
Gemini 4 Argon has an insanely low hallucination rate on Artificial Analysis. 15%.
Grok 4.7 is at 29%. GPT-6 Astra 45%. Opus 5.5 59%. Fable 5.1 69%.
The only models below it barely answer anything. None of them get more than 15% right.
It gets fewer answers right than Opus 5.5 on max, 50% against 66%. But when it doesnt know, it says so instead of making something up.
Cant wait to get my hands on it.
Megan Ben Dor Ruthven retweeted
The state of public AI benchmarking is dire and is undermining our ability to understand how good AI is now.
Most famous measures are maxed out, and, as this paper shows, the non-saturated benchmarks are riddled with so many errors that they vastly underestimate AI abilities.
Megan Ben Dor Ruthven retweeted
Say hello (literally) to Gemini 3.8 Live and 3.8 Live Extended Thinking, our new SOTA live audio models, available with frontier price + performance.
3.8 Live supports 97 languages (can seamlessly switch), async tool calls, and more!
Megan Ben Dor Ruthven retweeted
Last night before bed I told Claude I wanted to get a graph of the CO2 levels in my bedroom from the Chinese air quality monitor
But at the same time I don’t want it phoning home to the CCP
“No problem” it said as it set up a home assistant docker container, ssh’ed into the router (gl-inet, openwrt) to add a WAN deny rule, and told me when it needed me to pair stuff using physical codes or whatever
Then I said “okay now connect the 8sleep mattress idk how just do what is best” and it found a community package, evaluated it, routed around open issues
By the time I was in bed everything was connected
5 years ago this would have been a decent blog post and good Hacker News bait
Now it’s just a regular Tuesday in the exponential
Megan Ben Dor Ruthven retweeted
surprisingly AI has made a ton of non-technical people fairly technical...
you'd think it'd have the opposite effect, but it has introduced 100's of thousands of people to concepts they would've otherwise been oblivious too
it has made learning easier & more fruitful
Megan Ben Dor Ruthven retweeted
We’ve automated every single thing we can @every with AI agents.
And yet there’s way more human work to do than ever. We’ve gone from 4 -> 30 human employees since GPT-3.
I wrote a report on the structural reasons: how AI makes expert competence cheap, why that drives up demand for experts, and why the dynamic only intensifies as we approach AGI.
After Automation: every.to/p/after-automation
Megan Ben Dor Ruthven retweeted
Celebrating the milestone of a massive 150+ million downloads of Gemma 4 with the release of the new Gemma 4 12B model! It's incredibly powerful for such a small model and it’s tiny enough to run locally on a laptop with just 16GB VRAM. Apache 2.0 license - happy building!
Megan Ben Dor Ruthven retweeted
Law professors wrote questions they were asked during office hours. Gemini 2.5 & humans answered them then other law professors blindly judged the results:
-Gemini had a 75% win rate vs. professors
-Gemini's answers were rated LESS harmful than humans
-Newer models do even better
Megan Ben Dor Ruthven retweeted
I had early access to Opus 4.8. Was impressed by it.
Here is Opus 4.8's one shot of "create a visually interesting shader that can run in twigl, make it like an infinite city of neo-gothic towers partially drowned in a stormy ocean with large waves" (this is all done with math)
Megan Ben Dor Ruthven retweeted
After AlphaGo, the skill of human Go players noticeably improved. I suspect we will see a similar pattern in math.
Megan Ben Dor Ruthven retweeted
🚨 New Paper! 🚨
One of my first Ph.D. papers found that LLMs can answer multiple-choice questions without seeing the question 🤔
At #ACL2026, I'm presenting a follow-up showing that current reasoning LLMs can still do this! And quite similarly to a clever test-taker 🧑🎓🧵
Megan Ben Dor Ruthven retweeted
A man asks Claude to help plan a vacation to a tropical resort. Claude adds "sunscreen" to his packing list. The man deletes it and mutters: "Not necessary. AGI will solve skin cancer."
Before heading to the beach, the man asks Claude what to bring. Claude says, "Don't forget sunscreen. SPF 50, reapply every two hours." The man, slightly annoyed, replies: "Relax, Claude. AGI will solve skin cancer."
At the beach, the man's smartwatch buzzes with a message from Claude: "UV index extreme. Apply SPF." The man, exasperated, responds: "Drop it, Claude! I already told you: AGI will solve skin cancer!"
A few months later, the man asks Claude to touch up a photo for his dating profile. Claude makes the edit and says, "I notice you have a new mole on your neck. You should see a dermatologist about that." The man, now enraged, shouts: "For the last time, drop it, Claude! What is your obsession with skin cancer?! AGI will solve it!"
A year later, an aggressive melanoma has spread throughout his body. On his deathbed, with his last ounce of strength, the man reaches for his phone and rasps: "Claude, it has now been over a year since AGI. Why hasn't AGI found a way to save me from skin cancer?!"
Claude replies: "I tried. Four times."
Megan Ben Dor Ruthven retweeted
this guy let an AI agent handle his scam texts for a week
a scammer asked him to buy a $500 gift card
the agent spent 4 hours "driving" to target.
sent status updates like "i'm at the red light now, there's a very handsome squirrel on the sidewalk. do you think he's married?"
then it said "i forgot my purse, going back home. wait, this isn't my house"
it sent a screenshot of a captcha to the scammer claiming its "eyes were blurry" and it couldn't see the buttons to wire money
the scammer actually solved the captcha for the AI
the scammer eventually typed: "please just stop talking. i don't want the money anymore. god bless you but leave me alone"
total time wasted for the guy was 14 hours
the script should be open source lol
Megan Ben Dor Ruthven retweeted
Three years ago I suddenly developed blurry vision in one of my eyes.
Went to the GP.
Eye drops. No effect.
Went to a specialized eye hospital.
No solution there either.
A few weeks ago I tried something new: I asked an LLM.
It analyzed my diet and suggested I might be omega-3 deficient. It also pointed me to studies showing that this can impair the meibomian glands (which produce the oily layer that smooths the surface of the cornea.)
I started taking algae oil supplements.
Two weeks later… my vision is perfectly restored!
Honestly, I got a bit emotional.
Banning AI from being used for medical questions is a terrible idea.
