Monomorphism (@BetaGamma20) profile picture

Free is a left adjoint to a forgetful functor

Joined October 2022
Monomorphism retweeted
🔥 Serving coding agents well needs a high-performance prefill engine, but existing systems fall short. 🚀 Introducing SSEngine-GLM5.3-Flash: an open-source prefill engine for GLM-5.3-Flash on four B200 GPUs. It combines pipeline parallelism, a tiered prefix cache across GPU memory, DRAM and SSD, and a shortest-remaining-prefill-first scheduler. 📈 On real hardware, it sustains 3.1× (AgentX) and 3.2× (TraceLab) the request rate of any vLLM or SGLang setup we tested. 🧵 More in the thread below (1/8)
4
23
6
79
9,615
Monomorphism retweeted
🚀 Qwen, Kimi, GLM are all betting on linear attention. But it's still slow: the recurrent state is read & rewritten every token. Meet LeapQuant: the first training-free method to make 8-bit or 4-bit recurrent states work. 📈 Across Qwen, Kimi, and GLM models: • Matches FP32 accuracy • 4.25× faster linear attention kernels • Up to 2× higher inference throughput • Cuts memory by up to 56%
36
127
18
871
108,732
Monomorphism retweeted
很神奇的一期播客 openai员工的一手消息 但是下架了不知道为何
13
8
3
114
137,710
How to be a dev influencer: ❌Post valuable and thought provoking content ✅Shitpost about popular programming languages
19
4
3
236
15,100