Sobhan Mohammadpour (@___sobhan___) profile picture
Joined February 2025
Photo by Sobhan Mohammadpour (@___sobhan___)Photo by Sobhan Mohammadpour (@___sobhan___)
Sobhan Mohammadpour retweeted
Check out Toner! A general rule that preconditions the optimizer's update with each layer's input activations. Applied to Muon and AdamW as MuonT and AdamT, it speeds up LM pretraining, improving the critical batch size by ~2脳 over Muon.
7
21
3
170
28,783
Simple deep RL was thought to fail in imperfect-info games like poker. A new ICLR 2026 paper shows that with proper tuning, generic methods like PPO match or beat specialized approaches like fictitious play and counterfactual regret minimization. arxiv.org/abs/2502.08938 1/2
1
5
1
10
1,504
Sobhan Mohammadpour retweeted
It is becoming increasingly apparent that Carney is a modern Castlereagh.
"If great powers abandon even the pretense of rules & values for the unhindered pursuit of their power & interest, the gains from transactionalism will become harder to replicate" -- Carney's speech at Davos is an extended criticism of the damage Trump is doing (though he's not mentioning his name)
26
27
667
94,068
Never a dull moment
1
139
Sobhan Mohammadpour retweeted
TIL, this is actually valid Python.
1
2
206