Ankit Prateek retweeted
Crouching VRAM, Sleeping Dragon: How the Strata Family Makes Massive AI Models Run by Waking Only What They Need
uncategorized.blog/posts/cro…
#strata #glm #localLLM #inference #nvidia #rtx5090
Live Now | Supply Chain Security Village at c0c0n 2026
The Supply Chain Security Village is live at c0c0n 2026, bringing focused discussions and hands-on exploration of supply chain security to the conference.
Join the community at the village and be part of the learning, collaboration and knowledge sharing happening at c0c0n XIX.
09–10 October 2026
Grand Hyatt, Kochi, Kerala
Connect. Collaborate. Contribute.
#c0c0n2026 #c0c0n #SupplyChainSecurity #SecurityVillage #CyberSecurity #InformationSecurity
When the weekly token-limit line starts looking less like a usage meter and more like your lifeline, you know you have #WLDS 😭
I think I’ve developed a new mental health condition: Weekly Limit Doom Syndrome #WLDS.
At 80% usage remaining, every bug feels solvable.
At 5%, every minor issue feels like an architectural dead end and the model suddenly sounds disappointed in me.
(1/2)
I think I’ve developed a new mental health condition: Weekly Limit Doom Syndrome #WLDS.
At 80% usage remaining, every bug feels solvable.
At 5%, every minor issue feels like an architectural dead end and the model suddenly sounds disappointed in me.
(1/2)
Symptoms:
90% left: “We’ll figure this out.”
20% left: “This may require some restructuring.”
3% left: “The project has fundamental flaws.”
Complete remission immediately after the weekly reset.
(2/2)
Ankit Prateek retweeted
The race for AGI
Script: Sherpa by Pocket FM
Video: Seedance 2.5
🤖 Made with AI
You're welcome, everyone!
If you have been waiting for a sign from the universe to grant one new weekly session reset, this is it @OpenAI @OpenAIDevs
You are welcome, everyone! 😬
If you have been waiting for a sign from the universe to do a weekly session reset, this is it @ClaudeDevs @claudeai 🫣🥺
If you have been waiting for a sign from the universe to grant one new weekly session reset, this is it @OpenAI @OpenAIDevs
If you have been waiting for a sign from the universe to do a weekly session reset, this is it @ClaudeDevs @claudeai 🫣🥺
Stream the weights, shrink the KV cache, spare the Mac 😍
Replying to @deepseek_ai
💾 Smaller KV cache. Bigger savings.
Compared with the previous generation, V4.1-Flash’s KV cache needs just:
🔹 1/4 the HBM
🔹 1/8 the SSD storage
Cache-hit charges often account for a large share of agent costs. Compressing the cache cuts those costs significantly.
3/6
#AIME 2025, run locally, thinking on: 90.0% pass@1. Two of three misses were 64K truncations, not wrong answers – 96.7% with a 128K budget.
On a desktop Mac.
The Quantization Tax Nobody Charged: #Qwen 3.8 27B Q4 Quant Matches Its Published Scores on a Single #RTX5090 @Alibaba_Qwen
youtu.be/qhGds3DVizg
uncategorized.blog/posts/the…
#localLLM
Ankit Prateek retweeted
Everyone budgets a quality tax for 4-bit quants. I went looking for it on #Qwen 3.8 27B: GPQA, IFBench, 95 real CVEs, RULER at 262K, KL-divergence.
The tax never showed up — Q4 matches @Alibaba_Qwen 's published BF16 scores on a single #RTX5090.
uncategorized.blog/posts/the…
#localLLM
This has really taken @claudeai's image and video generation abilities to a whole new level.
Not a new brain – but new eyes: the same Claude that writes the HTML can now watch the video it made, closing the create→inspect→fix loop locally, zero external model calls.
👀 Seeing is just the beginning.
With Qwen-MM-Plugins, turn your favorite agent harness multimodal-native — read images, videos & documents, edit videos, work with 3D/CAD, and more.
From multimodal models → multimodal agents. 🚀
Watch it in action:
github.com/QwenLM/Qwen-MM-Pl…


















