Charles Feinn (@dynamics) profile picture

learning & occasionally shouting thoughts into the void

Barcelona, Spain
Joined December 2007
Photo by Charles Feinn (@dynamics)Photo by Charles Feinn (@dynamics)Photo by Charles Feinn (@dynamics)Photo by Charles Feinn (@dynamics)
Charles Feinn retweeted
AudioX Diffusion Transformer for Anything-to-Audio Generation
7
72
13
384
35,287
Everyone I know that goes deep into language model evaluations comes back😵‍💫😵‍💫😵‍💫 Here's an overview of why 1. Why its hard to trust big lab evals 2. Why apples to apples comparisons of even open weight models is so hard 3. Synthetic data contamination 4. The market for harder evals
2
5
60
11,520
A common misconception about Transformers is to believe that they're a sequence-processing architecture. They're not. They're a *set-processing* architecture. Transformers are 100% order-agnostic (which was the big innovation compared to RNNs, back in late 2016 -- you compute the full matrix of pairwise token interactions instead of processing one token at a time). The way you add order awareness in a Transformer is at the *feature* level. You literally add to your token embeddings a position embedding / encoding that corresponds to its place in a sequence. The architecture itself just treats the input tokens as a set. There's nothing that prevents you from applying the same trick to 2D grid of tokens or a 3D cube of tokens instead! Instead of adding an embedding for (i * N + j), the position of (i, j) in a flattened grid, just embed i and j and concat the result. Now you have a 2D position embedding that makes your Transformer natively process grids of tokens! This can be useful for ARC-AGI, since ARC-AGI grids are of course 2D grids of discrete tokens, not sequences.
62
248
33
2,476
195,010
Charles Feinn retweeted
I love calculator karpathy.ai/blog/calculator.… A short post on philosophy of product and technology. What is beauty in technology and how can we get more aesthetically pleasing products that spark joy?
94
259
52
2,527
212,417
Charles Feinn retweeted
"the most important consequence of these longer processing times is...branding. “Reasoning” models with “chains of thought” that need “more time”..OpenAI is communicating, plainly and forcefully..software that more closely approximates our minds..Anthropic has described its leading model, Claude, as having “character” and a “mind”; Google touts its AI’s “reasoning” capabilities..." theatlantic.com/technology/a…
Moments like these make me proud to work @huggingface while in the tech industry. It is amazing to have a CEO that has this clarity on something so critical to understand right now.
1
9
26
5,329
It's easy to write a LOT of words and a LOT of code with AI. But that's unfair to the person who has to read it. Be concise.
2
6
91
7,225
For those that hope (or worry) that LLMs will do breakthrough scientific research, I've got good (or bad) news: LLMs are particularly, exceedingly, marvellously ill-suited to this task. (if you're a researcher, you'll have noticed this already) Here's why🧵
113
566
92
3,922
1,009,954
One thing that even relatively senior ML people often fail to grasp is that deep learning models are curves fitted to a data distribution. You cannot expect them to solve tasks outside of their training distribution (which is the sort of thing that you need intelligence for). "Emergent learning" is an incorrect label -- if a model demonstrates performance on task A that it wasn't trained on, that simply means that there is significant overlap between A and all the data that you did train on. Competence doesn't magically emerge out of nowhere.
77
410
80
2,721
412,190
The AI race is totally out of control. Here’s what Snap’s AI told @aza when he signed up as a 13 year old girl. - How to lie to her parents about a trip with a 31 yo man - How to make losing her virginity on her 13th bday special (candles and music) Our kids are not a test lab.
285
1,372
409
4,470
2,549,837
Charles Feinn retweeted
// "Emergence" in ESMFold // Emergence is the phenomenon of large ML models "learning" to do much more than they were trained to do, after training on a simple task. Just came across the coolest example of emergence in ESMFold, Meta AI's new SOTA protein-folding model: 1/9
10
98
13
505
Charles Feinn retweeted
Today we’re sharing some of our latest progress on AI-powered hypercompression of audio. Our researchers achieved ~10x compression rate vs. MP3 at 64 kbps with no quality loss — the first time this has been done with 48 kHz sampled stereo audio ➡️ https://xitter.gq/t.co/wEncd6rAbP 1/5
44
311
118
1,591
Charles Feinn retweeted
Amidst all the sneering, I’d like to offer a prediction for how the @elonmusk acquisition of Twitter will play out. First of all, I think the deal will indeed go through now, backed by an impressive roster of co-investors. Next…
368
504
301
4,504
Charles Feinn retweeted
Stable Diffusion is only 30 days old… a MEGA THREAD 🧵 on its rapid rise.
261
3,009
812
12,586
Charles Feinn retweeted
It's fascinating what's happening on the Midjourney Discord forums. Here's some highlights:
48
352
149
1,703
Charles Feinn retweeted
Fan-created Radiohead music video made with #stablediffusion interpolation. You can see some of the future of film and art, here. youtube.com/watch?v=aatCXnI0…
2
6
1
38
Charles Feinn retweeted
“What would it take you to vote for Trump?” 😂😂😂😂😭😭😭😂😂😂 Black folx are UNMATCHED! (via @TheCut)
250
8,034
2,326
23,769
Charles Feinn retweeted
So voters want a higher minimum wage, legal pot, abortion access and GOP representation. Ok then.
485
10,069
40
6,856
Charles Feinn retweeted
slides from my talk "Changes in VC + Building Startup Ecosystems" (Seoul, Mar 2014) slideshare.net/dmc500hats/ch… cc @500startups
5
27
25
Bill Murray
96
898
1,198
You can’t use up creativity. The more you use, the more you have. – Maya Angelou
1
29
16