Pinned Tweet
1/x Twitter, Wikipedia, the internet in general, really isn't a place to get information on whole, but rather a place to get an idea of what you should research further. The spread of disinformation, misinformation, or lies, is never the true problem...
Tom Reiner retweeted
The question of whether LLMs can reason is, in many ways, the wrong question. The more interesting question is whether they are limited to memorization / interpolative retrieval, or whether they can adapt to novelty beyond what they know. (They can't, at least until you start doing active inference, or using them in a search loop, etc.)
There are two distinct things you can call "reasoning", and no benchmark aside from ARC-AGI makes any attempt to distinguish between the two.
First, there is memorizing & retrieving program templates to tackle known tasks, such as "solve ax+b=c" -- you probably memorized the "algorithm" for finding x when you were in school. LLMs *can* do this! In fact, this is *most* of what they do. However, they are notoriously bad at it, because their memorized programs are vector functions fitted to training data, that generalize via interpolation. This is a very suboptimal approach for representing any kind of discrete symbolic program. This is why LLMs on their own still struggle with digit addition, for instance -- they need to be trained on millions of examples of digit addition, but they only achieve ~70% accuracy on new numbers.
This way of doing "reasoning" is not fundamentally different from purely memorizing the answers to a set of questions (e.g. 3x+5=2, 2x+3=6, etc.) -- it's just a higher order version of the same. It's still memorization and retrieval -- applied to templates rather than pointwise answers.
The other way you can define reasoning is as the ability to *synthesize* new programs (from existing parts) in order to solve tasks you've never seen before. Like, solving ax+b=c without having ever learned to do it, while only knowing about addition, subtraction, multiplication and division. That's how you can adapt to novelty. LLMs *cannot* do this, at least not on their own. They can however be incorporated into a program search process capable of this kind of reasoning.
This second definition is by far the more valuable form of reasoning. This is the difference between the smart kids in the back of the class that aren't paying attention but ace tests by improvisation, and the studious kids that spend their time doing homework and get medium-good grades, but are actually complete idiots that can't deviate one bit from what they've memorized. Which one would you hire?
LLMs cannot do this because they are very much limited to retrieval of memorized programs. They're static program stores. However, can display some amount of adaptability, because not only are the stored programs capable of generalization via interpolation, the *program store itself* is interpolative: you can interpolate between programs, or otherwise "move around" in continuous program space. But this only yields local generalization, not any real ability to make sense of new situations.
This is why LLMs need to be trained on enormous amounts of data: the only way to make them somewhat useful is to expose them to a *dense sampling* of absolutely everything there is to know and everything there is to do. Humans don't work like this -- even the really dumb ones are still vastly more intelligent than LLMs, despite having far less knowledge.
Tom Reiner retweeted
I like free markets, the rule of law, opportunity & meritocracy. I am not a fan of Russian-style oligarchy where the government is a mafia that uses its power to help or hurt businesses based on their allegiance (and "donations") to the boss.
Tom Reiner retweeted
wagner dead
russian training center hit with atacms
aircraft lost (a lot)
attacks are failing
they just bombed russia, again (russian air force)
ukr drones are tearing them up
losses are up
a senior russian stated the war is lost
POWs are up
south russia still without power
black sea fleet is only using subs
for the first time in a long time im seeing NO good news from the russian side on twitter or TG... things are changing
Tom Reiner retweeted
Campaign for @Billbrowder getting the 2024 Peace Nobel Prize. (Too late for 2023) Bill is leading a global campaign for justice since tax lawyer Sergei Magnitsky was murdered by Putin's regime of millionaires. He knows how to act: strike at their dirty money.
Switzerland Freaks Out After US Congressional Committee Calls for Magnitsky Sanctions Against 3 Swiss Officials Involved in Perverting Justice by Returning $14 million That Was Previously Frozen to Sanctioned Russians thedailybeast.com/switzerlan…
Tom Reiner retweeted
Ensure Archery Classes and Hunter Education Continue to Receive Federal Funding actionalerts.archerytrade.or…
Tom Reiner retweeted
This woman comes from a social class were nobody was ever forced to suffer the consequences of their actions and choices. Now reality is quite literally spitting in her face and the only thing she can do is complain about the lack of police or bystanders willing to help her.
This is a pretty prevalent blind spot for a lot of liberals and progressives. When you destroy all social norms, social cohesion, tradition, etc... the only thing you are left with is raw power and they are not capable of operating in a world were might makes right even though that is the world they are busy creating.
It's Mission-Command (Auftragstaktik) and is the founding doctrine of US military doctrine. It is decentralized, so it can only be carried out by a society that has been free for a while. It's why the Russians and Chinese have a shit show of an NCO corps.
youtube.com/shorts/Ei_b00DiC…
Ukrainian's in a trench enjoying the relaxing sounds of orcs getting their souls cluster-bombed right out of their bodies.
Tom Reiner retweeted
Russian orcs have triggered it. Instead of having generations of peaceful creative people, Ukraine will host generations of warriors. It is a huge trauma for the Ukrainians. But no chance for the orcs. I am so sorry for Ukrainians who have to go through this. It is terrible.
Tom Reiner retweeted
Roman grave monument for a beloved horse, with a moving epitaph:
'You once outran the wandering birds and beat the northwest winds, now you graze no longer in Tuscan woods and Siculan fields, but rest stabled in this tomb.'
From Brescia, 2nd century AD, Verona Maffeiano Museum
"any attack by the Wagner Group will be seen as an attack by the Russian government.” -US Ambassador to the UN.
usun.usmission.gov/remarks-b…
Tom Reiner retweeted
“The Nazis entered this war under the rather childish delusion that they were going to bomb everyone else, and nobody was going to bomb them. At Rotterdam, London, Warsaw, and half a hundred other places, they put their rather naive theory into operation. They sowed the wind, and now they are going to reap the whirlwind.” -
Arthur ‘Bomber’ Harris, 1942.
We need more of this energy today tbh
Tom Reiner retweeted
Free Russians from Kirov took the baton of the rail war 🔥
-1 SCB at a major transport hub of the Trans-Siberian railway.The expanding geography of arson attacks on railway and military infrastructure says only one thing: there are more and more of us, and the victory of Free Russia is getting closer.
Tom Reiner retweeted
We stand in full support of Olha Harlan, the talented Ukrainian fencer who declined to shake hands with her russian opponent following her victory in a duel. We condemn russia’s exploitation of sports to support its war of aggression.
🇺🇦❤️🤺
Replying to @AmandaMcCrina
I remember the teacher focusing (rightly) hard on the evils of Nazism but glossing over Stalinism. My Ukrainian American friend bringing up the holdomor and being shushed by the teacher (who hadn't a clue). My friend escalated till he was dragged out of class and suspended.
Tom Reiner retweeted
South African media outlet Daily Maverick, who regularly reports on Russian corruption in Afirca has their accreditation for Russia-Africa Summit revoked dailymaverick.co.za/article/…
Tom Reiner retweeted
Psyche: Asteroid With $10 Quintillion Worth of Metals (Gold, Iron, Nickel, Silicon, Lithium, etc) Edges Closer to US Reach. The NASA Psyche Mission is less than 100 days away. Psyche is scheduled launch atop a SpaceX Falcon Heavy rocket from Space Launch Complex 39A at Kennedy Space Center at 10:38 a.m. EDT (7:38 a.m. PDT) on Thursday, October 5, 2023. The launch window stretches to Wednesday, October 25, 2023.




























