Leading research at @arcee_ai | Formerly Data Research Lead @DbrxMosaicAI | Visiting Researcher @meta | Ph.D | #TXSTFOOTBALL fan | https://xitter.cf/t.co/4G6Jf3b0V4

Redwood City, CA
Joined August 2011
I’m so incredibly proud of what we are building at @arcee_ai . It’s a truly special place. We are only getting started though. We’ve been quiet for a while, but we haven’t been idle. I can’t wait to share more about what we have been grinding on for the past ~6 months. I won’t spoil anything, but you can get some idea from this announcement.
Today, we are announcing our Series B funding round, valuing the company at more than $1B. This round accelerates our next-gen Trinity models across diverse infrastructure, expands our work with the DOE and national labs on Genesis-Science-1, and enables us to build the platform teams need to build, evaluate, deploy, and operate open models in production. We are grateful to our team, partners, open-source community, and investors. Led by @Vista_Equity, Cambium Capital, and @emergencecap, with participation from AI10 Ventures, @Hitachi, IAG, @M12vc, @p7ventures, and @Wipro.
4
7
1
107
6,096
Cody Blakeney retweeted
It would take like 30 minutes to explain why I'm getting images sent to me at work on slack, but it is pretty sick.
3
1
20
702
I mean who isn’t these days
lmao john schulman just basically blurts out that thinking machines is working on a continual learning model
1
18
780
The things you can do with data get so much cooler as your context length grows. Literally a limitless playground of imagination.
2
21
669
Which lab has the best model tech reports these days? What sets them apart?
2
13
822
I changed my mind. I think I can teach the model spite.
22
519
The data must be cleaned
High alpha in looking at the data
3
1
31
697
a year later and I think they may be still running for 20 years the way GPU rental prices are going.
So in like 5 ish years ... what is going to happen to all the H100s ... landfill?
2
2
17
692
Turns out this is also true for a lot of people in industry too
If gradstudents knew what actually worked in training SOTA LLMs they would be so mad
20
662
I bet new grads I'll be interviewing before long won't even know what Tensorflow is. I had to explain to one of the younger people on my team yesterday what Caffe2 was 🙃
People I work with have called me a “boomer” because I used tensorflow at the beginning of my PhD
5
26
617
TIL Waymos turn the windshield wipers on when it's raining 🤷‍♂️
6
16
706
Cody Blakeney retweeted
They are swizzling me at work tomorrow.
1
2
14
746
It would take like 30 minutes to explain why I'm getting images sent to me at work on slack, but it is pretty sick.
3
1
20
702
Cody Blakeney retweeted
The reason Standford/Ivy League grads tell you to drop out of college is because they tell themselves "my accomplishments come from my own hard work" and not "I owe a large portion of my success to my school"
so funny to see the amount of people with @ ivy league and @ big tech on their bios hating on gabriel for saying this "status for me, but not for thee"
7
9
308
7,140
Cody Blakeney retweeted
Forward pass: 1s Backwards pass: 2s Optimizer step: 0.5s Hashing everything: 600s Allreduce: 1s Someone with strong systems-performance intuition, please take a serious pass at this code. The urgency is unfortunately load-bearing: my family is dying
15
10
1
417
19,727
Does anyone remember the Yi family of LLMs? Those were great.
1
10
636
They are swizzling me at work tomorrow.
1
2
14
746
Cody Blakeney retweeted
to a rough approximation, 0% of people who complain about ai writing have written anything this insightful or valuable
bj mf it occurred to me upon waking that the west has somehow managed to simultaneously kill the classical and romantic spirits and this explains a lot about what's going on for those of you who are paying attention hashing this out with gpt and this essay is full of bangers i would add further that all of this has all happened because men have forgotten god in a solzhenitsynian sense
1
19
782
A country of geniuses not available in a data center.
2
1
37
1,270
I swear to go people saying things are AI slop without reading the substance as if that is a trump card that invalidated any conversation is so fucking annoying. It doesn’t make you sound smart, it actually makes you sound lazy. Yes there is real slop in the world, yes it’s annoying. Being smart enough to identify that someone has used an LLM to edit writing doesn’t mean you don’t have to read or think critically. FWIW I’m not talking about my own writing (I make too many spelling mistakes to be accused of slop)
5
1
1
20
1,767