
#FloridaMan, lifelong educator, lapsed scholar (HKU PhD). 20 years in the Pearl River Delta. writing about systems, AI, infrastructure, history, and theory
Canton
Joined December 2008
- Tweets29.5K
- Following7.3K
- Followers8.2K
- Likes66.9K
Pinned Tweet
My model world is up as a GitHub Page. Still in beta.
- Angkor econ, collapse, rise, etc
- Fertility collapse lab
- shadow education
- ed massification
- Out-of-Africa routes
- more!
Everything is meant for users to tinker with
Needs a new name.
treymodels.github.io/atlas-o…
hardcore genetarians not gonna like this
Starting ~10,000 years ago, humans in many parts of the world switched from foraging to farming. How did that shift shape our genomes?
Our new paper in @NatEcoEvo, led by Bridget Chak, tackles this with 1,092 genomes. It's open access (link at the end).
A thread 1/11
trey retweeted
Each word you say is planned by a small patch of brain above your left ear, about a quarter of a second before you say it. It sits in a temporal lobe region textbooks describe as only for listening. Our paper today in @ScienceMagazine: science.org/doi/10.1126/scie…
@UCSF @NeurosurgUCSF
trey retweeted
Amazingly beautiful.
Chomsky was wrong.
Researchers from UC Berkeley and Google DeepMind cracked one of the biggest mysteries in AI.
For years, scientists have been finding impossible geometric shapes hidden inside the brains of LLMs.
Calendar months arrange themselves into literal circles.
Historical years bend into smooth, rippled timelines.
Cities organize themselves into actual 2D maps of latitude and longitude.
Everyone assumed this proved massive transformers were spontaneously inventing complex "world models" out of thin air.
They were wrong.
This paper proves you don't need a massive LLM for any of this to happen.
Even basic, decade-old word embeddings like word2vec produce the exact same circles, timelines, and maps.
The geometry isn't coming from the AI's architecture.
It’s coming from a hidden mathematical property inside human language itself.
Researchers call it translation symmetry.
In natural text, how often any two months appear near each other depends almost entirely on the time gap between them.
January and February share the same statistical relationship as July and August.
When a neural network trains on data with that kind of symmetry, the math forces it to learn Fourier representations, literal sine and cosine waves.
The circles? Those are the long waves.
The strange "ripples" researchers found on AI timelines? Just higher harmonics.
Here is the craziest part.
Rresearchers tried to break it.
They deleted every single sentence in the training data where two months appeared together. No "January" next to "February." No "March" next to "April."
And the circle formed anyway.
Why? Because the geometry is a collective phenomenon across the entire language.
Even if two months never touch in a sentence, they are both pulled into orbit by thousands of other words tied to the same seasons, weather, and events.
The rest of human language forces the shape into existence.
trey retweeted
Unbelievably funny that the banks had to tell SpaceX “no we will not lend to you if you shoot the collateral of the loan into space.”
“.. lenders have expressed concerns that if the group later decided to shoot the valuable chips that underpin their loans into space, it would prevent them from reclaiming and selling the semiconductors in the event of a default ..”
@FT $SPCX
ft.com/content/33b5643c-2957…
trey retweeted
This is one of my favorite scientific figures in computational social science: the Division of Democrat and Republican Party members of the U.S. House of Representatives from 1949–2012. You can see our history in a figure resembling mitosis.
journals.plos.org/plosone/ar…
trey retweeted
Xi Jinping logró algo imposible, matemáticamente hablando: que una mesa redonda tuviera una cabecera.
trey retweeted
Not to be insensitive, but the Space Shuttle isn’t a good example of a safety culture. It’s an example of a culture where warnings were ignored by management at the cost of lives.
When I flew the Space Shuttle, we didn’t just hope things would go right. We tested systems and had a plan if things went wrong. We’ve spent decades managing risks in space travel, defense, and other high-risk industries. But right now, AI companies are policing themselves without any real safeguards. My framework puts that proven expertise to work to make AI safe.
trey retweeted
Han chinese urge to impose monoculturalism has no bounds
It never ceases to amaze me at how liberal democrats globe types just eagerly throw Indian under the bus as being intrinsically inferior to the Chinese just to make sure no blame gets attached to the democratic system.
But let’s do a thought experiment shall we? Freaky Friday style. Let’s say it was a Ghandi-style pacifist Democrat that somehow got a hold of China and an Indian Mao that took control from the British.
Let’s just focus on language.
I find it hard to believe a China that was democratic from the start would have been able to institute mandarin as the universal tongue. Probably something like what happened in India would have happened to China. Mandarin could be put in place as the official language while each region would have its own dialect as the co-official language for that region.
It would have proved a terrible barrier to national unity and prosperity. Regional governments would be strong. Regional inequality terrible. Xinjiang, Tibet and Inner Mongolia would easily be pried away. China would have remained the tray of loose sand with no coherency. More prosperous provinces might even agitate for autonomy.
I can easily see it turning out worse than India today in fact.
Meanwhile, if India had a strongman period that did nothing but broke caste definitively and imposed Hindi as the official language, it would almost certainly have a brighter future today.
trey retweeted
This was a deliberate attempt to humiliate a head of state. She's said publically that she has chronic rheumatoid arthritis for more than 10 years.
trey retweeted
China builds world’s biggest lazy susan: diners need 8-foot spoon to reach giant plate of Shenzhen ‘mystery pink slurry’ specialty.
trey retweeted
I'd never read the original proclamation by the Indians of All Tribes group that occupied Alcatraz for 19 months in 1969-70. It's pretty funny!
“I’ve never taken a research methods class because I have an English PhD and was dropped into a sustainability curriculum to chat about sci-fi. Anyways, here’s what I think about people who need research methods to publish…”
trey retweeted
imagine telling someone from the 80s that one of these guys was a socialist and the other one was the capitalist
trey retweeted
If you're still concerned about citation hallucination by LLMs, you're about 2 years behind here.
interesting. A lot of them are staying in HK. Makes sense - you can be in Qianhai in 20-30 minutes straight drive if they open the border for you
🇺🇸总统特朗普:深圳东海朗廷酒店
🇷🇺总统普京:深圳前海康莱德酒店
🇰🇷总统李在明:深圳鹏瑞莱佛士酒店
🇧🇳文莱苏丹哈桑纳尔:深圳柏悦酒店
🇲🇾马来总理安瓦尔:深圳瑞吉酒店
🇲🇽墨西哥总统辛鲍姆:深圳四季酒店
🇨🇱智利总统卡斯特:深圳四季酒店
🇮🇩印尼总统普拉博沃:深圳万豪酒店
🇹🇭泰国总理佩通坦:深圳安达仕酒店
🇻🇳越南主席苏林:深圳文华东方酒店
🇵🇬总理马拉佩:香港西九龙酒店
🇨🇦加拿大总理卡尼:香港西九龙酒店
🇦🇺总理阿尔巴尼斯:香港西九龙酒店
🇵🇪秘鲁总统藤森庆子:深圳四季酒店
3
491







































