
Leading research at @arcee_ai | Formerly Data Research Lead @DbrxMosaicAI | Visiting Researcher @meta | Ph.D | #TXSTFOOTBALL fan | https://xitter.cf/t.co/4G6Jf3b0V4
Redwood City, CA
Joined August 2011
- Tweets22.6K
- Following2K
- Followers7.9K
- Likes50.7K
Cody Blakeney retweeted

JT@jiratickets3h
United States
United StatesConnected via United States App StoreAccount-level information, not a live location or per-post device.
the internet didn’t implode so now I still have to go to work. thanks for nothing
Replying to @xeophon @_vatsadev
Or you start a heavy drinker and open up the data. Hard to say.
Yes, but the better question is why. Is it good and a product of squeezing our performance or an unintended artifact of some training stage.
Replying to @thomashikaru
Our hypothesis: LLMs have a pressure for information density, leading to compressed language, novel ngrams, and a preference for short alternatives in linguistic alternations, even when this is not humanlike - humans have a pressure for successful communication with other humans
Cody Blakeney retweeted
It would take like 30 minutes to explain why I'm getting images sent to me at work on slack, but it is pretty sick.
Replying to @stochasticchasm @osoleve
Well @stochasticchasm ? What are the bangers?
The things you can do with data get so much cooler as your context length grows. Literally a limitless playground of imagination.





