Local Inference maniac, now I spend more time exploring Agentic Engineering than gaming
0xMX
Joined February 2009
- Tweets48.3K
- Following1K
- Followers895
- Likes75.4K
Pinned Tweet
“Remember: Everything fails, all the time, so plan for failure and nothing fails.”
- @Werner
People is using ddr3 machines to run models at a surprising speed 🫡
Old DDR3 Xeons are supposed to be e-waste for local AI.
75 tok/s. Qwen 3.8 Flash Next, a 180B model, answering after a 172K-token prompt.
The box: two Xeon E5-2670 v2 with no AVX2, 64 GB of DDR3, PCIe 2.0. And 2x CMP 50HX mining cards, memory-modded from 10 GB to 20 GB each.
On 1 October Strata refused any CPU without AVX2. On 4 October it ran them.
xrip measured this box on his own build of Strata 0.2.0: 65.5 tok/s by default, 75.1 with 19 CPU workers, six runs.
Why it works: 98% of the experts sit on the 2x mining cards. The old CPU computes the other 2%.
Which old Xeons run it, and the October fight that got Strata there: Issue 2 of The Local LLM Sizing Guide, out tomorrow.
vramcalculator.com/sizing-gu…
Glitch 81 ᯅ retweeted
LFM3-VL-2B vs Gemma 4 E2B on 50 real scanned receipts.
LFM3 got 41 of 50 receipts fully right. Gemma got 28. 50 receipts from SROIE, same prompt, JSON out, one 5060 Ti 16 GB.
- LFM3-VL-2B: 95% of fields right, 41/50 receipts perfect, 46 s
- Gemma 4 E2B: 87% of fields right, 28/50 receipts perfect, 62 s
Across both tests: Gemma reads messy chat-style text a bit better (95% vs 90%). LFM3 reads receipts better, and was faster both times.
@liquidai @googlegemma
Introducing 𝙻𝙵𝙼𝟹: our new generation of Liquid Foundation Models. With a new tri-hybrid architecture and new multimodal encoders, the LFM3 family is the ideal model suite for specialized intelligence.
> 6 model instances, across text, audio, vision, and omni modalities, generative and decision models.
> 𝙻𝙵𝙼𝟹-𝟷.𝟽𝙱: text, 256k context window.
> 𝙻𝙵𝙼𝟹-𝚅𝙻-𝟸𝙱: vision-language model with video-input support for spatial understanding
> 𝙻𝙵𝙼𝟹-𝙰𝚞𝚍𝚒𝚘-𝟸𝙱: tool calls, voice chat, reasoning in 18 languages.
> 𝙻𝙵𝙼𝟹-𝙾𝚖𝚗𝚒-𝟸𝙱: an omni model combines vision, audio, and language.
> 𝚍𝟷-𝟸𝙱 and 𝚍𝟷-𝙾𝚖𝚗𝚒-𝟸𝙱: decision models with typed outputs and calibrated probabilities in a single pass. Omni adds audio input.
> fine-tune on 1 GPU.
> a new tri-hybrid architecture
> architecture optimized for 14 processor classes across GPUs, CPUs, and NPUs.
> 𝙻𝙵𝙼𝟹-𝚅𝙻-𝟸𝙱 is a beast. It performs competitively with Gemma 4 12B (6x larger), and Gemini 3.5 Flash Lite, and GPT-5.6 Luna, with 1.9B parameters.
> 𝙻𝙵𝙼𝟹-𝟷.𝟽𝙱 is #1 on the Pareto frontier of device intelligence 𝚙𝚒𝚙𝚎𝚝𝚝𝚎.𝚕𝚒𝚚𝚞𝚒𝚍.𝚊𝚒
Every modality for specialized intelligence. Pick the one that fits your use case, customize it, and run it on-device.
1/ 🧵
Glitch 81 ᯅ retweeted
CUDA Live: Introduction to CUDA Rust xitter.gq/i/broadcasts/1RKZzBapW…
Glitch 81 ᯅ retweeted
Want more tokens per second on your NVIDIA DGX Spark? ⚡
Explore three techniques to accelerate MoE inference, from optimized kernels and FP8 quantization to multi-token prediction.
ALT Rectangular device with textured front on a wooden table, greenery in background.
Glitch 81 ᯅ retweeted
Silicon Valley has officially gone too far. 😂
First, we couldn’t stop checking our phones at the gym, now we’re checking whether our AI agents have finished the code between sets.
New gym rule: No vibe coding between sets.
Forget leg day. We’re skipping debug day.
Remember: Your AI agent can wait. Your gains can’t.
Although, knowing tech bros, someone’s already building an AI personal trainer that lifts for them. 🤣
Glitch 81 ᯅ retweeted
‼️ ALERT - Hackers exploited a critical Cisco SD-WAN flaw (CVSS 10.0) to plant "KeyDrift" malware designed to steal encryption keys protecting traffic between sites.
The malware also provides backdoor access, with infrastructure links to a network used by Volt Typhoon.
Full details ↓ thehackernews.com/2026/10/ha…
Glitch 81 ᯅ retweeted
New in Claude for Legal: a gallery of ready-made artifacts for contract review, regulatory horizon scans, cite checks, and more.
Start from the built-in example, add your own documents and connectors, and share it with anyone across the business.
Does Gemini Carbon still bitches about you curse in your prompt??
Actual @GeminiApp when you say “f#ck” on any conversation:
Introducing Gemini 4 Carbon, it's a big jump over Argon which we released just 2 weeks ago.
Gemini 4 Carbon is SOTA on cyber, long horizon tasks, ranks #1 on Artificial Analysis V5, significantly improves on usability in domains like coding, and is more aligned.
Amazing 🤣🫡
Meet NVIDIA Nemotron 3.5 Transcribe 🎙️
An open-weight, promptable 30B MoE model with ~4B active parameters that brings transcription in 40 languages, speaker attribution, translation, contextual prompting and audio understanding into one checkpoint.
Watch it keep track of who said what when everyone’s talking at once.
1/ 🧵
What i love the most about this is the cartridge to emulator stuff.
Full Mario 64 in Mixed Reality! Running in real 3D (no stereoscopic crap) natively at 90FPS and also running on my desk! 😋
Again, Opus 5.5 + PICO CLI combo made it quite straightforward.
Such a bliss to play an oldie at 90 FPS in 3D.
Disclaimer: I own an original physical copy of Mario 64. This project is not associated with Nintendo or PICO.
