co-founder, board @coreauto - and continuing to aspire to understand deep learning.

Joined December 2017
It turns out multi step backpropaganda is better. paper has a beautiful way of improving backpropagation. One iteration cleanly gets us backprop, multiple iterations get us a preconditioned update.
5
13
1
238
175,591
Being cooked and cooking are the same physical process with difference being whether you're the ingredient or the chef.
7
1
66
5,055
Cancer patients with the same diagnosis often have very different tumor biology. Molecular testing can reveal underlying differences, but that's slow and expensive. Introducing Holon-S1, our platform to predict genes and biomarkers from routine pathology slides. • beats two other models at predicting spatial gene activity in a controlled comparison • has identified potentially novel biomarkers in breast cancer and colon cancer • evaluated across 16 organ types and more than 15 scanners, using slides from both formalin-fixed, paraffin-embedded and fresh-frozen tissue. We believe Holon-S1 has the potential to help researchers find new biomarkers in slides they already have, discover treatment targets, and bring more personalized cancer care within reach!
165
338
74
2,538
216,511
Shale oil changed the supply curve of energy. The equivalent AI breakthrough would change the supply curve of intelligence. Lets just do that
3
2
63
4,383
When research breakthroughs come months earlier than compute is when you know.
3
1
2
141
11,764
rohan anil retweeted
a few things since riley posted this: 1/ *you don't have to be a student!* we've been SO energized by applicants deep into their careers with crazy ideas they now think are possible with agents 2/ you'll get to rethink what an organization is when it's run with and by agents that only get smarter from here. starting w/ our own lab & now these businesses, i'm convinced the future is a few people with judgment & a budget, plus agents that learn from the real world, doing what used to take a whole org -- not a smarter assistant for each of us. 3/ you'll get to work with riley, which is _actually_ life-changing. i've been the luckiest ever to work with him for 8 months now, and he's the most creative person i know: he ships the opposite of slop, so freaking quickly, with full commitment to the bit & craft. then there's also everyone else at core auto + at least one person joining soon who thinks unlike anyone i've met <3 applications are rolling. apply now! coreauto.com/AGM
Some news: 5 months ago I joined @coreauto, a small research lab focused on new ways for models to learn. I’m also hiring four interns to do something my younger self would've loved. It started with a pretty unusual project. We set up a handful of small online businesses, and put an agent in charge. We gave each business some initial funding and a seed idea, and off they went, trying to sell real things to real customers while we watched. It’s about as open-ended and unforgiving a task as you can probably give to an agent, with countless decisions to make and effects that take time to become clear. Each business got its own bank account, a debit card to pay suppliers, a web browser, an email inbox, a domain name, cloud infrastructure and a schedule. Every few hours, the agent woke up and decided what to do. It might update a landing page, adjust an ad campaign, reply to a customer, and then go back to sleep. The agents built actual storefronts and apps. They bought ads, attracted visitors, and even made some sales. The agents acted as operators that kept a business moving, but we noticed they never really stepped back to strategize about what might move the needle. If people weren’t buying, why? Was the landing page unappealing? Or maybe the offer itself was the problem? One amusing example was the very first order a customer placed. Our supplier had run out of stock. But it’s a dropshipping business, and thankfully tens of other suppliers carried the same product. Instead of trying another supplier, the agent almost immediately sent the customer a polite apology and attempted to issue a refund. Gah! So close! The agents could handle much of the work of getting a business up and running. What they struggled with was deciding what to change when it wasn’t working. That’s what we want to understand. We also want to see what changes when people take the lead. What does a business operator actually do all day when agents can do so much? What new work does this allow them to do? Which decisions can’t be delegated? — So this winter we're hiring 4 interns as Associate General Managers. Associate Product Manager internships are programs that give early career generalists a product to own. We want to try something similar, but with entire businesses. You’ll create and grow businesses, with agents handling the routine work so you can focus on figuring out what matters. Each AGM gets a budget and our agent infrastructure that’s designed for this. Which ideas to try is up to you. Put more money behind what finds customers and keep refining. Where you step in tells us what agents can't do yet. You'll be in our SF office with me and people I’m so fortunate to work with, like @_arohan_, @joannejang, @MillionInt, @marksaroufim and @juliacvillagra We don't care much where you went to school or what your resume looks like. We’re looking for enterprising people with a drive to create, who’ve made money on the internet before and already use AI extensively to enable their ideas. If that sounds like you: coreauto.com/AGM
11
5
287
24,214
I am putting in a lot of work for this talk, to synthesize a decade of work on training systems at scale. Maybe I had the unique point of view of scaling many generations of training systems
The @lancedb marketing team may have gotten a little carried away with the cat profile pic for our Reverie keynote speaker 🐱 The keynote by @_arohan_ at #Reverie2026 is going to be killer. Tix are going fast. Register meow! reveriesummit.com/?utm_mediu…
4
3
63
4,596
The @lancedb marketing team may have gotten a little carried away with the cat profile pic for our Reverie keynote speaker 🐱 The keynote by @_arohan_ at #Reverie2026 is going to be killer. Tix are going fast. Register meow! reveriesummit.com/?utm_mediu…
2
2
1
13
5,083
I heard people are codistilling which is better than distilling.
7
55
9,009
Hahahahahaa
"Let Us Pause and Appreciate Theorem 7!" Gemini Argon veers into a mindfulness exercise in the middle of a long proof.
3
32
5,153
I hope I get access to Argon ZDR, have been patiently waiting. I think I can use it well.
argon took that personally 😭
1
1
1
78
30,117
This is great
We’re committing a portion of Anthropic’s shares to the Anthropic Public Benefit Fund, a new wholly owned entity dedicated entirely to the public benefit. It will start off with 5% of our shares. For every 50% increase in the company’s value over a set baseline, we can contribute up to an extra 2%, subject to our board’s discretion. In total, this means that roughly 20% of Anthropic’s shares are committed to the public good. Our co-founders have already pledged to donate 80% of their equity, and around half our employees are donating a portion of their equity as part of a donation matching program we’ve run since our founding. In the post below, we share more details about our new fund. anthropic.com/news/public-be…
3
77
8,940
rohan anil retweeted
We’re committing a portion of Anthropic’s shares to the Anthropic Public Benefit Fund, a new wholly owned entity dedicated entirely to the public benefit. It will start off with 5% of our shares. For every 50% increase in the company’s value over a set baseline, we can contribute up to an extra 2%, subject to our board’s discretion. In total, this means that roughly 20% of Anthropic’s shares are committed to the public good. Our co-founders have already pledged to donate 80% of their equity, and around half our employees are donating a portion of their equity as part of a donation matching program we’ve run since our founding. In the post below, we share more details about our new fund. anthropic.com/news/public-be…
2,305
1,756
1,672
21,557
7,575,757
more intelligent entity being controlled by a less intelligent one, I feel like I found a counter example, my cat controls my sleep schedule for the last month. Though there is an assumption here that I am smarter than a cat.
10
1
62
4,956
But if you give my cat, agents, he maybe able to button smash to agi
3
947
Sometimes just stare at the same algebra puzzle for many years, you find the solution is to add a superscript and subscript.
2
1
36
4,903
Ok you cant mine this alpha!
3
6
1,509
Mass ai psychosis
if your employer does not give you a spirit animal, its not a serious place to work at
4
53
5,012
Aurko is right
The evolution of interleaved SWA and global layers with window size 512 happened due to merging Routing Transformer (github.com/google-research/g…) with scan layers - XLA likes repeated blocks to reduce compilation time. Doing top-k sparse attention proved to be harder on TPUs and most of the successful sparsification has happened on GPUs (deepseek, minimax etc).
3
1
66
8,699
This is why Gemma has this pattern
5
1,008