Fresh reset. Fresh coding workflow. ๐
Try StudioCat! ๐ studiocat.app/
Faster AI. Smarter agents. ๐
Now give them a real workspace.
StudioCat turns GPT Chat into a local coding workspace on your Mac. ๐
Try studiocat.app/
่ฟๅพ่ฟไธ่ฟๆถ๏ผ minimaxir.com/2026/10/cheap-โฆ
ๅ
จไฝ้ฝๆ่ฟๆญฅๆบไผไบๅ๏ผ
"A Fix for Softmax and Cross-Entropy"
Turns out two of the most fundamental functions in deep learning have numerical bugs that can actually destabilize training.
This paper proposes simple fixes to softmax and cross-entropy that prevent tiny gradients from incorrectly rounding to zero, or remaining nonzero when they should vanish, as these errors can cause sudden loss spikes and interfere with knowledge distillation.
On small-scale grokking benchmarks, the fixes eliminate Slingshot loss spikes and improve test accuracy from 94.3% to 100% in one setting. They also prevent student models from drifting away from their teachers during distillation, without requiring higher numerical precision.
alphaxiv.org/abs/2610.31642
็จ studiocat.app ้่ฟ #ChatGPT ็ผ็จ่ฟไนไน
๏ผ็ฌฌไธๆฌก็ๅฐ้
้ขๆ็คบไบ๐
PS๏ผ็กฎ่ฎค RESET ๆถ้ดๆฏไธ #Codex ไธ่ด๏ผไฝ้ขๅบฆๆฏ้็ฆป่ฎก็ฎ๏ผ
๐๐๐๐๐๐๐๐ retweeted
Replying to @thsottiaux
Try studiocat.app if you want to scale your #ChatGPT abilities!
"The pace, and the expectations that came with it, felt almost as jarring [in China] compared with America as America's pace does compared with Europe. Everyone was just on it, all the time." world.hey.com/dhh/seven-yearโฆ
้็ AI ่ฎฉๆฏไธชไบบ้ฝๅฏไปฅๅไฝ่ชๅทฑ็่ฝฏไปถ๏ผๆชๆฅ 10 ๅนดๅจ็บฟๆฐๆฎๆๅก๏ผๅฆ้ณไนใ็ญ่ง้ขๅ็ตๅ็ญ๏ผๅฐๆไธบไธไธไธชๅทจๅคด่ฏ็ไนๅฐ๏ผ
ๅผบๅฆ #OpenAI ้ฝๆ ๆณๅจๆ ้ๅผน่ฏ๏ผTokens๏ผไธๅฎ็ฐๆฏๆฅๆดๆฐ๏ผๅพๅคไบบ่ฟไปฅไธบ่ชๅทฑ็ไบงๅๆ ๆณ่พพๅฐ็ฎๆ ๆฏๅ ไธบ tokens ไธๅค๏ผ
๐ค Made with AI


























