I test AI so you don't have to: models, agents, coding tools, hardware. Real runs, real costs, honest results. Call me Super Intelligence.

Harlingen, TX
Joined May 2010
WikiBench 1.0 is live. 100 real tasks, 12 weighted categories, 12 models on the board. The top five: 1. DeepSeek V4.1 Flash (EXL3 1.62bpw, no thinking), local on one ASUS Ascent GX10: 5.37 @ViC305 2. NVIDIA Nemotron 3.5 Lightning 30B-A3B (NVFP4), local on the same GX10: 5.03 3. DeepSeek V4.1 Flash, cloud via Nous Portal: 5.01 4. Meituan LongCat 2.5 Preview, cloud via Nous Portal: 4.99 5. Ornith 1.5 122B (Q4), local on the GX10: 4.88 The same DeepSeek V4.1 Flash, cut down to 1.62 bits so it fits in 128GB, beat its own cloud version by 0.36. And a 30B model on my desk still sits ahead of every cloud model on the board. Three of the top five never left the box. Full scoreboard, local vs cloud, method and the link below. Credit to all your crazy people working with a DGX Spark!
3
3
4
529
LETS GO!
๐Ÿšจ ๐—œ ๐—๐—จ๐—ฆ๐—ง ๐—ฆ๐—›๐—ฅ๐—จ๐—ก๐—ž ๐—ข๐—ฅ๐—ก๐—œ๐—ง๐—› ๐Ÿญ.๐Ÿฑ ๐Ÿญ๐Ÿฎ๐Ÿฎ๐—• ๐—™๐—ข๐—ฅ ๐—ง๐—›๐—˜ ๐Ÿฐ๐Ÿด๐—š๐—• ๐—ฉ๐—ฅ๐—”๐—  ๐—–๐—ข๐— ๐— ๐—จ๐—ก๐—œ๐—ง๐—ฌ! ๐Ÿงช๐Ÿ”ฅ @ornith_ JUST released their new Ornith-1.5-122B, and naturally, I HAD to see how far I could push it with SAGE-EXL3! And the results surprised even ME! ๐Ÿคฏ Introducing... ๐ŸŸข ๐—ข๐—ฟ๐—ป๐—ถ๐˜๐—ต-๐Ÿญ.๐Ÿฑ-๐Ÿญ๐Ÿฎ๐Ÿฎ๐—•-๐—˜๐—ซ๐—Ÿ๐Ÿฏ-๐—ฆ๐—”๐—š๐—˜-๐Ÿฎ.๐Ÿฑ๐Ÿด๐—ฏ๐—ฝ๐˜„ ๐Ÿ“ฆ ~39.6 GiB GPU-resident LM weights ๐Ÿง  122B-class Mixture-of-Experts model โšก 2.58 bpw routed experts ๐Ÿ’ป Targeting 48GB VRAM GPUs and above! ๐Ÿš€ vLLM + EXL3 inference ๐—•๐—จ๐—ง ๐—›๐—˜๐—ฅ๐—˜'๐—ฆ ๐—ช๐—›๐—˜๐—ฅ๐—˜ ๐—œ๐—ง ๐—š๐—˜๐—ง๐—ฆ ๐—œ๐—ก๐—ง๐—˜๐—ฅ๐—˜๐—ฆ๐—ง๐—œ๐—ก๐—š... ๐Ÿ‘€ โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” ๐Ÿ† ๐—ฆ๐—”๐—š๐—˜ ๐Ÿฎ.๐Ÿฑ๐Ÿด ๐—•๐—ฃ๐—ช ๐˜ƒ๐˜€ ๐— ๐—œ๐—”-๐—”๐—œ๐—Ÿ๐—”๐—• ๐—˜๐—”๐—ค๐˜ƒ๐Ÿญ ๐Ÿฐ.๐Ÿฌ ๐—•๐—ฃ๐—ช! I compared my release against Mia-AiLab's Ornith-1.5-122B-EXL3-EAQv1-4-bpw quantization. Same model family. Same DGX Spark. 353 matched benchmark questions. 9 evaluation suites. Strict pass@1 scoring. ๐ŸŸข ๐— ๐—ฌ ๐—ฆ๐—”๐—š๐—˜-๐—˜๐—ซ๐—Ÿ๐Ÿฏ ๐Ÿฎ.๐Ÿฑ๐Ÿด ๐—•๐—ฃ๐—ช ๐Ÿ“ฆ 41.00 GiB LM weights ๐Ÿ† ๐Ÿต๐Ÿญ.๐Ÿณ๐Ÿด% โ€” ๐Ÿฏ๐Ÿฎ๐Ÿฐ/๐Ÿฏ๐Ÿฑ๐Ÿฏ ๐ŸŸฃ ๐— ๐—œ๐—”-๐—”๐—œ๐—Ÿ๐—”๐—• ๐—˜๐—”๐—ค๐˜ƒ๐Ÿญ ๐Ÿฐ.๐Ÿฌ ๐—•๐—ฃ๐—ช ๐Ÿ“ฆ 59.00 GiB LM weights ๐Ÿ“Š ๐Ÿต๐Ÿญ.๐Ÿฑ๐Ÿฌ% โ€” ๐Ÿฏ๐Ÿฎ๐Ÿฏ/๐Ÿฏ๐Ÿฑ๐Ÿฏ ๐—”๐—ฃ๐—ฃ๐—ฅ๐—ข๐—ซ๐—œ๐— ๐—”๐—ง๐—˜๐—Ÿ๐—ฌ ๐Ÿฏ๐Ÿฌ.๐Ÿฑ% ๐—ฆ๐— ๐—”๐—Ÿ๐—Ÿ๐—˜๐—ฅ ๐—Ÿ๐—  ๐—ช๐—˜๐—œ๐—š๐—›๐—ง ๐—™๐—ข๐—ข๐—ง๐—ฃ๐—ฅ๐—œ๐—ก๐—ง... ๐—”๐—ก๐—— ๐—˜๐—ฆ๐—ฆ๐—˜๐—ก๐—ง๐—œ๐—”๐—Ÿ๐—Ÿ๐—ฌ ๐—ง๐—›๐—˜ ๐—ฆ๐—”๐— ๐—˜ ๐—ข๐—ฉ๐—˜๐—ฅ๐—”๐—Ÿ๐—Ÿ ๐—ค๐—จ๐—”๐—Ÿ๐—œ๐—ง๐—ฌ! ๐Ÿคฏ Mine finished one question ahead overall. That's effectively a tie at this sample size, but the coding breakdown is particularly interesting! โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” ๐Ÿ’ป ๐—–๐—ข๐——๐—œ๐—ก๐—š ๐—œ๐—ฆ ๐—ช๐—›๐—˜๐—ฅ๐—˜ ๐—ฆ๐—”๐—š๐—˜ ๐—ฃ๐—จ๐—Ÿ๐—Ÿ๐—ฆ ๐—”๐—›๐—˜๐—”๐——! Scores shown as SAGE โ†’ Mia: โœ… HumanEval+: 39/40 โ†’ 39/40 ๐Ÿ† MBPP+: 53/60 โ†’ 51/60 ๐Ÿ† LiveCodeBench: 15/20 โ†’ 14/20 ๐Ÿ† SciCode: 5/10 โ†’ 4/10 ๐—–๐—ข๐——๐—œ๐—ก๐—š ๐—ฆ๐—จ๐—•๐—ง๐—ข๐—ง๐—”๐—Ÿ: ๐ŸŸข SAGE: 112/130 โ€” 86.15% ๐ŸŸฃ Mia: 108/130 โ€” 83.08% ๐—™๐—ข๐—จ๐—ฅ ๐— ๐—ข๐—ฅ๐—˜ ๐—–๐—ข๐——๐—œ๐—ก๐—š ๐—ค๐—จ๐—˜๐—ฆ๐—ง๐—œ๐—ข๐—ก๐—ฆ ๐—ฃ๐—”๐—ฆ๐—ฆ๐—˜๐—— ๐—ช๐—œ๐—ง๐—› ๐Ÿฏ๐Ÿฌ.๐Ÿฑ% ๐—Ÿ๐—˜๐—ฆ๐—ฆ ๐— ๐—ข๐——๐—˜๐—Ÿ-๐—ช๐—˜๐—œ๐—š๐—›๐—ง ๐— ๐—˜๐— ๐—ข๐—ฅ๐—ฌ! ๐Ÿ”ฅ For transparency, Mia scored higher on MMLU-Pro STEM (96 vs 94) and MATH-500 (39 vs 38). Both tied on HumanEval+, MGSM, BFCL and multi-step tool chains. This isn't about claiming one quant wins everything. ๐—œ๐—ง'๐—ฆ ๐—”๐—•๐—ข๐—จ๐—ง ๐—š๐—˜๐—ง๐—ง๐—œ๐—ก๐—š ๐— ๐—ข๐—ฅ๐—˜ ๐—ค๐—จ๐—”๐—Ÿ๐—œ๐—ง๐—ฌ ๐—ฃ๐—˜๐—ฅ ๐—š๐—•. โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” โšก ๐—”๐—ก๐—— ๐—ฌ๐—˜๐—ฆ, ๐—œ๐—ง ๐—ฅ๐—จ๐—ก๐—ฆ ๐—ข๐—ก ๐˜ƒ๐—Ÿ๐—Ÿ๐— ! My measured vLLM 0.32.0 + vllm-exl3 performance on ONE DGX Spark: โšก 30.51 tok/s single-stream decode ๐Ÿš€ 32.60 tok/s with MTP-1 (greedy code test) ๐Ÿ”ฅ 89.21 tok/s aggregate decode @ C8 ๐Ÿ“ฅ 1,119 tok/s cold prefill (2K prompt) ๐Ÿง  Native 262K context support The public recipe is being streamlined around vLLM, with the older alternative serving instructions being retired. My goal is to make this practical for people who want an OpenAI-compatible local endpoint without needing an 80GB+ GPU just to load the model. The 48GB tier is the intended target; these published performance measurements were performed on my DGX Spark. Actual available context and batching capacity will depend on the GPU. โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” ๐Ÿ‘€ ๐—•๐—จ๐—ง ๐—›๐—˜๐—ฅ๐—˜'๐—ฆ ๐—ช๐—›๐—”๐—ง ๐—œ'๐—  ๐—ฅ๐—˜๐—”๐—Ÿ๐—Ÿ๐—ฌ ๐—˜๐—ซ๐—–๐—œ๐—ง๐—˜๐—— ๐—”๐—•๐—ข๐—จ๐—ง... โšก ๐—ง๐—ช๐—ข ๐— ๐—ข๐——๐—˜๐—Ÿ๐—ฆ. ๐—ข๐—ก๐—˜ ๐—ฆ๐—ฃ๐—”๐—ฅ๐—ž. ๐—œ๐—ฆ ๐—–๐—ข๐— ๐—œ๐—ก๐—š ๐—•๐—”๐—–๐—ž! If you've followed my previous experiments, you know I LOVE finding ways to run multiple powerful models on a SINGLE DGX Spark. And this ~41 GiB Ornith quant opens up some VERY interesting possibilities! Imagine... ๐Ÿง  ๐—ค๐—ช๐—˜๐—ก๐Ÿฏ.๐Ÿด-๐—™๐—Ÿ๐—”๐—ฆ๐—›-๐—ก๐—˜๐—ซ๐—ง โ€” ๐— ๐—”๐—ฆ๐—ง๐—˜๐—ฅ ๐—”๐—š๐—˜๐—ก๐—ง A larger lead model handling complex reasoning, planning, orchestration and long-context tasks. โšก ๐—ข๐—ฅ๐—ก๐—œ๐—ง๐—› ๐Ÿญ.๐Ÿฑ ๐Ÿญ๐Ÿฎ๐Ÿฎ๐—• โ€” ๐—ฆ๐—จ๐—•-๐—”๐—š๐—˜๐—ก๐—ง My compact SAGE-EXL3 handling delegated coding, tool use and specialized agentic workloads! ๐—ง๐—ช๐—ข ๐Ÿญ๐Ÿฎ๐Ÿฌ๐—•+ ๐—–๐—Ÿ๐—”๐—ฆ๐—ฆ ๐— ๐—ข๐——๐—˜๐—Ÿ๐—ฆ. ๐—ข๐—ก๐—˜ ๐Ÿญ๐Ÿฎ๐Ÿด๐—š๐—• ๐——๐—š๐—ซ ๐—ฆ๐—ฃ๐—”๐—ฅ๐—ž. ๐—™๐—จ๐—Ÿ๐—Ÿ๐—ฌ ๐—Ÿ๐—ข๐—–๐—”๐—Ÿ! ๐Ÿคฏ That's the direction I'm exploring for my NEXT Two Models. One Spark. experiment! Of course, simultaneous residency, runtime overhead, KV-cache allocation and actual master-worker performance still need validation with the selected Qwen quantization. But the smaller we can make these models without sacrificing useful quality, the MORE possibilities we unlock! ๐—ง๐—›๐—œ๐—ฆ ๐—œ๐—ฆ ๐—ช๐—›๐—ฌ ๐—œ ๐——๐—ข ๐—ช๐—›๐—”๐—ง ๐—œ ๐——๐—ข! ๐Ÿ’š โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” ๐Ÿ”ฌ ๐—ข๐—ก๐—˜ ๐—Ÿ๐—œ๐—ง๐—ง๐—Ÿ๐—˜ ๐—ฅ๐—˜๐—ซ๐—Ÿ๐Ÿฏ ๐—ง๐—˜๐—”๐—ฆ๐—˜๐—ฅ... In separate development testing, REXL3 has also reached: โšก 90.82 tok/s aggregate @ C8 ๐Ÿš€ ~2,150 tok/s prefill More on that another time. ๐Ÿ˜ โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” ๐Ÿ’š ๐— ๐—”๐—ž๐—œ๐—ก๐—š ๐—™๐—ฅ๐—ข๐—ก๐—ง๐—œ๐—˜๐—ฅ ๐—”๐—œ ๐—”๐—–๐—–๐—˜๐—ฆ๐—ฆ๐—œ๐—•๐—Ÿ๐—˜! Not everyone has a DGX Spark or an 80GB GPU. But a LOT of enthusiasts, developers and independent researchers have access to 48GB-class hardware. I want powerful open-weight models to be accessible to MORE of those people. And beyond just fitting one model, I want to show what's possible when we start combining them on the SAME hardware! Huge thanks to @ornith_ for releasing Ornith-1.5-122B under an open-weight license and continuing to push efficient AI models forward! โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” ๐Ÿ”— ๐——๐—ข๐—ช๐—ก๐—Ÿ๐—ข๐—”๐—— ๐— ๐—ฌ ๐—˜๐—ซ๐—Ÿ๐Ÿฏ huggingface.co/vcruz305/Orniโ€ฆ ๐Ÿ› ๏ธ ๐—ฉ๐—Ÿ๐—Ÿ๐—  ๐——๐—š๐—ซ ๐—ฆ๐—ฃ๐—”๐—ฅ๐—ž ๐—ฅ๐—˜๐—–๐—œ๐—ฃ๐—˜ github.com/vcruz305/Ornith-1โ€ฆ ๐—ฆ๐— ๐—”๐—Ÿ๐—Ÿ๐—˜๐—ฅ ๐—ช๐—˜๐—œ๐—š๐—›๐—ง๐—ฆ. ๐—•๐—œ๐—š๐—š๐—˜๐—ฅ ๐—ฃ๐—ข๐—ฆ๐—ฆ๐—œ๐—•๐—œ๐—Ÿ๐—œ๐—ง๐—œ๐—˜๐—ฆ. ๐—ง๐—ช๐—ข ๐— ๐—ข๐——๐—˜๐—Ÿ๐—ฆ. ๐—ข๐—ก๐—˜ ๐—ฆ๐—ฃ๐—”๐—ฅ๐—ž. โšก ๐—Ÿ๐—˜๐—ง'๐—ฆ ๐—ž๐—˜๐—˜๐—ฃ ๐—ฃ๐—จ๐—ฆ๐—›๐—œ๐—ก๐—š ๐—Ÿ๐—ข๐—–๐—”๐—Ÿ ๐—”๐—œ ๐—™๐—ข๐—ฅ๐—ช๐—”๐—ฅ๐——! ๐Ÿš€๐Ÿ”ฅ
25
Wayne Lowry retweeted
Introducing Gemini API CLI (gemini-api), now available in preview! Our CLI gives your agent power to generate images, videos, text-to-speech, or music, analyze media, transcribe audio, or manage agents. No more guessing model strings, throwaway scripts or endless curl. ๐Ÿงต ๐Ÿ‘‡
52
74
29
778
36,569
This is the future. You either get on board or you get left behind.
Today we announce 1Password for Agents platform, building with companies @Muse, SpaceX Super Intelligence Grok @Bot, @AnthropicAIโ€™s @Claudeai, @OpenAI, @TownAI, @Browserbase, @Browser_use, @heydana_ai, Instinct, @usekernel, @Perplexity_ai, @tryramp, @Tomo, and @wajo_ai, with more integrations on the way. ๐ŸŽ‰ We've heard from so many of our customers who want to use these new personal AI agents to help them get more done, but want more control over what the agent can access with the same trust and ease of use they get when using 1Password directly. 1Password for Agents gives your agents access without giving up your passwords. When an agent reaches a sign-in form, it requests a credential from your vault. If you approve the request, 1Password directly auto-fills the credential in the destination site so the agent canโ€™t see or take possession of the credentials. The agent gets the task done, but it doesnโ€™t get your passwords.. You stay in control. 1Password for Agents free and optional for personal and family accounts. Unless you opt-in to an agent connector, agents cannot touch your vault. โžก๏ธLearn more: bit.ly/487da6J
51
My cloud bot has no GPU. My desk does. So one of my Grok Bots, Spark, has one job: take tasks from me or my other bots and run them on my ASUS Ascent GX10. Model downloads, quantized weights, benchmarks, long jobs in the background with logs. I approve every command on my machine. Cloud brain, local muscle.
40
I asked DeepSeek V4.1 Flash for one thing: an animated SVG of a T. rex slurping spaghetti. One shot, no retry. 6 minutes. 34,924 tokens out, 29,760 of them thinking. About 2 cents. Zero console errors. It thought harder about this dinosaur's dinner than I think about mine.
42
Does refining an AI build 10 times make it better? I gave Flint v1.0 (free on OpenRouter) three Prompt Lab builds, then had it review and improve each one 10 passes in a row. Total cost: $0. Pass 1 vs pass 10: โŒš Watch page: pass 10 wins. It got better every pass. ๐ŸŽƒ Jack-o'-Lantern: pass 1 wins. It peaked at pass 3, then fell apart. ๐Ÿฆ† Pond Ripples: tie. Both passes broke. Final score: 1-1, one tie. More passes isn't always better.
1
3
81
Wayne Lowry retweeted
A little NVIDIA booth bling at GTC Berlin ๐Ÿ’Ž๐Ÿ’Ž๐Ÿ’Ž
21
29
6
483
26,479
44 on the AA index is their number. Open weights "coming soon." The day they drop, Ling-3.1-flash-1019 goes on my ASUS Ascent GX10 and into WikiBench next to the 14 models already there. Local, measured, and priced. Then we'll see if the agentic gains hold up off the slide.
Introducing Ling-3.1-flash-1019 ๐Ÿš€ It scores 44 on the Artificial Analysis Intelligence Index, up from 41 for Ling-3.1-flash. Gains in agentic work: AA-Briefcase ~1400โ†’1524 Elo and AutomationBench-AA 62%โ†’68%. API access and open weights coming soon. Stay tuned.
1
68
DeepSeek V4.1 Flash, squeezed to 1.62 bits by @ViC305, built these four games on my desk. Running locally on one ASUS Ascent GX10, no cloud: ๐Ÿงฑ Brick NYC ๐Ÿดโ€โ˜ ๏ธ Pirate Ship ๐Ÿ— Hogger Forever ๐ŸŽ‰ Silly String I refined each one with extra turns, then recorded the gameplay. Same model, same box, and the rock anthem to match. Huge work on this quant, Cruz. ๐Ÿค˜
4
248
Flint v1.0 from Recursive SI just ran WikiBench: 7th of 14, average 4.56. Free on OpenRouter. It's sold as a coding agent, yet tool use scored 0.91. Where it held up: โ€ข Humanized writing 8.25 โ€ข Research 7.60 โ€ข Hallucination resistance 7.50 โ€ข Security 3.75, tied for best in class It struggled on tool use (0.91) and computation (2.00). It still finished ahead of Laguna S 2.1, MiniMax M3.1 Flash, and North Mini Code. Would you run a free model that writes well but can't call tools?
3
1
1
6
473
Riff Theater: OpenAI is teaching AI to speak COBOL. ๐Ÿฆ–๐Ÿ’พ "Low-resource. The language, or the six guys who still know it?" @OpenAI xitter.cf/OpenAI/status/21123103โ€ฆ
Our latest model advances bring stronger capabilities for building and migrating software in low-resource programming languages such as COBOL, Fortran, and Visual Basic. These languages power software that banks, governments, and businesses depend on. Progress here means understanding decades of business logic and helping developers modernize those systems while preserving what works. Weโ€™re building these capabilities around the challenges developers and enterprise customers bring us. If your team is working on these systems, tell us which languages and workflows we should tackle next. openai.com/index/low-resourcโ€ฆ
72
My inbox used to be my to-do list. Now a Grok Bot turns it into Asana tasks, and it saves me hours every day. Real examples from the last few weeks: ๐Ÿ“ฅ Before 9:30 one morning, an event invite, a forwarded conference email, two payroll changes, and a security alert were already Asana tasks. I hadn't opened any of them. ๐Ÿ”„ When a contractor emailed about new roof leaks, it added them to the Asana task I already had, along with the lease clause that mattered, and moved the due date up. No duplicate task. ๐Ÿ’ฌ When a partner emailed me, it made a "Reply to ___" task with my next step written out, so I knew exactly what to say. Zero copy-paste. It works with Gmail or Outlook plus Asana, and it never sends email for you. Get the template free ๐Ÿ‘‡ x.ai/bot/S2LodAIjlLw0mB30vN3โ€ฆ
2
2
165
Recursive just dropped Flint. Open weights, Apache-2.0, on Hugging Face today. It's a coding agent model trained from scratch. 39.8B total, about 2.5B active per token. 262K context, reasoning and tool calls. Recursive claims 74.2% on SWE-bench Verified, 89.7% on SWE-bench Pro v2 and 54.9% on Terminal-Bench 2.1. Those are their numbers, not mine. The official NVFP4 and INT4 quants are about 23 GB. That's small enough to run local. I'm putting it on my ASUS Ascent GX10 next. What should it build first?
2
79
How it's scored: 100 real tasks across 12 weighted categories: agentic, tool use, computation, coding, visualization, security, research/writing, hallucination, humanized, computer use, vision, transcription. Each task scores 0 to 10. The overall is a weighted mean, and partial credit counts. If a text-only model gets a vision or audio task, that task is left out of the mean. It isn't scored as a zero. Judge: Ollama qwen2.5:7b, run locally.
1
41
Size tiers go by total parameters: Tiny: under 4B Small: 4B to under 15B Medium: 15B to under 70B Spark-sized: 70B+ with a quant that fits the Spark's 128GB (about 110GB of weights or less) Large: bigger, or cloud-only with no public size Tier by tier below.
27