Pinned Tweet
WikiBench 1.0 is live. 100 real tasks, 12 weighted categories, 12 models on the board.
The top five:
1. DeepSeek V4.1 Flash (EXL3 1.62bpw, no thinking), local on one ASUS Ascent GX10: 5.37 @ViC305
2. NVIDIA Nemotron 3.5 Lightning 30B-A3B (NVFP4), local on the same GX10: 5.03
3. DeepSeek V4.1 Flash, cloud via Nous Portal: 5.01
4. Meituan LongCat 2.5 Preview, cloud via Nous Portal: 4.99
5. Ornith 1.5 122B (Q4), local on the GX10: 4.88
The same DeepSeek V4.1 Flash, cut down to 1.62 bits so it fits in 128GB, beat its own cloud version by 0.36.
And a 30B model on my desk still sits ahead of every cloud model on the board.
Three of the top five never left the box.
Full scoreboard, local vs cloud, method and the link below.
Credit to all your crazy people working with a DGX Spark!
LETS GO!
๐จ ๐ ๐๐จ๐ฆ๐ง ๐ฆ๐๐ฅ๐จ๐ก๐ ๐ข๐ฅ๐ก๐๐ง๐ ๐ญ.๐ฑ ๐ญ๐ฎ๐ฎ๐ ๐๐ข๐ฅ ๐ง๐๐ ๐ฐ๐ด๐๐ ๐ฉ๐ฅ๐๐ ๐๐ข๐ ๐ ๐จ๐ก๐๐ง๐ฌ! ๐งช๐ฅ
@ornith_ JUST released their new Ornith-1.5-122B, and naturally, I HAD to see how far I could push it with SAGE-EXL3!
And the results surprised even ME! ๐คฏ
Introducing...
๐ข ๐ข๐ฟ๐ป๐ถ๐๐ต-๐ญ.๐ฑ-๐ญ๐ฎ๐ฎ๐-๐๐ซ๐๐ฏ-๐ฆ๐๐๐-๐ฎ.๐ฑ๐ด๐ฏ๐ฝ๐
๐ฆ ~39.6 GiB GPU-resident LM weights
๐ง 122B-class Mixture-of-Experts model
โก 2.58 bpw routed experts
๐ป Targeting 48GB VRAM GPUs and above!
๐ vLLM + EXL3 inference
๐๐จ๐ง ๐๐๐ฅ๐'๐ฆ ๐ช๐๐๐ฅ๐ ๐๐ง ๐๐๐ง๐ฆ ๐๐ก๐ง๐๐ฅ๐๐ฆ๐ง๐๐ก๐... ๐
โโโโโโโโโโโโโโโโโโโโ
๐ ๐ฆ๐๐๐ ๐ฎ.๐ฑ๐ด ๐๐ฃ๐ช ๐๐ ๐ ๐๐-๐๐๐๐๐ ๐๐๐ค๐๐ญ ๐ฐ.๐ฌ ๐๐ฃ๐ช!
I compared my release against Mia-AiLab's Ornith-1.5-122B-EXL3-EAQv1-4-bpw quantization.
Same model family.
Same DGX Spark.
353 matched benchmark questions.
9 evaluation suites.
Strict pass@1 scoring.
๐ข ๐ ๐ฌ ๐ฆ๐๐๐-๐๐ซ๐๐ฏ ๐ฎ.๐ฑ๐ด ๐๐ฃ๐ช
๐ฆ 41.00 GiB LM weights
๐ ๐ต๐ญ.๐ณ๐ด% โ ๐ฏ๐ฎ๐ฐ/๐ฏ๐ฑ๐ฏ
๐ฃ ๐ ๐๐-๐๐๐๐๐ ๐๐๐ค๐๐ญ ๐ฐ.๐ฌ ๐๐ฃ๐ช
๐ฆ 59.00 GiB LM weights
๐ ๐ต๐ญ.๐ฑ๐ฌ% โ ๐ฏ๐ฎ๐ฏ/๐ฏ๐ฑ๐ฏ
๐๐ฃ๐ฃ๐ฅ๐ข๐ซ๐๐ ๐๐ง๐๐๐ฌ ๐ฏ๐ฌ.๐ฑ% ๐ฆ๐ ๐๐๐๐๐ฅ ๐๐ ๐ช๐๐๐๐๐ง ๐๐ข๐ข๐ง๐ฃ๐ฅ๐๐ก๐ง...
๐๐ก๐ ๐๐ฆ๐ฆ๐๐ก๐ง๐๐๐๐๐ฌ ๐ง๐๐ ๐ฆ๐๐ ๐ ๐ข๐ฉ๐๐ฅ๐๐๐ ๐ค๐จ๐๐๐๐ง๐ฌ! ๐คฏ
Mine finished one question ahead overall. That's effectively a tie at this sample size, but the coding breakdown is particularly interesting!
โโโโโโโโโโโโโโโโโโโโ
๐ป ๐๐ข๐๐๐ก๐ ๐๐ฆ ๐ช๐๐๐ฅ๐ ๐ฆ๐๐๐ ๐ฃ๐จ๐๐๐ฆ ๐๐๐๐๐!
Scores shown as SAGE โ Mia:
โ
HumanEval+: 39/40 โ 39/40
๐ MBPP+: 53/60 โ 51/60
๐ LiveCodeBench: 15/20 โ 14/20
๐ SciCode: 5/10 โ 4/10
๐๐ข๐๐๐ก๐ ๐ฆ๐จ๐๐ง๐ข๐ง๐๐:
๐ข SAGE: 112/130 โ 86.15%
๐ฃ Mia: 108/130 โ 83.08%
๐๐ข๐จ๐ฅ ๐ ๐ข๐ฅ๐ ๐๐ข๐๐๐ก๐ ๐ค๐จ๐๐ฆ๐ง๐๐ข๐ก๐ฆ ๐ฃ๐๐ฆ๐ฆ๐๐ ๐ช๐๐ง๐ ๐ฏ๐ฌ.๐ฑ% ๐๐๐ฆ๐ฆ ๐ ๐ข๐๐๐-๐ช๐๐๐๐๐ง ๐ ๐๐ ๐ข๐ฅ๐ฌ! ๐ฅ
For transparency, Mia scored higher on MMLU-Pro STEM (96 vs 94) and MATH-500 (39 vs 38). Both tied on HumanEval+, MGSM, BFCL and multi-step tool chains.
This isn't about claiming one quant wins everything.
๐๐ง'๐ฆ ๐๐๐ข๐จ๐ง ๐๐๐ง๐ง๐๐ก๐ ๐ ๐ข๐ฅ๐ ๐ค๐จ๐๐๐๐ง๐ฌ ๐ฃ๐๐ฅ ๐๐.
โโโโโโโโโโโโโโโโโโโโ
โก ๐๐ก๐ ๐ฌ๐๐ฆ, ๐๐ง ๐ฅ๐จ๐ก๐ฆ ๐ข๐ก ๐๐๐๐ !
My measured vLLM 0.32.0 + vllm-exl3 performance on ONE DGX Spark:
โก 30.51 tok/s single-stream decode
๐ 32.60 tok/s with MTP-1 (greedy code test)
๐ฅ 89.21 tok/s aggregate decode @ C8
๐ฅ 1,119 tok/s cold prefill (2K prompt)
๐ง Native 262K context support
The public recipe is being streamlined around vLLM, with the older alternative serving instructions being retired.
My goal is to make this practical for people who want an OpenAI-compatible local endpoint without needing an 80GB+ GPU just to load the model.
The 48GB tier is the intended target; these published performance measurements were performed on my DGX Spark. Actual available context and batching capacity will depend on the GPU.
โโโโโโโโโโโโโโโโโโโโ
๐ ๐๐จ๐ง ๐๐๐ฅ๐'๐ฆ ๐ช๐๐๐ง ๐'๐ ๐ฅ๐๐๐๐๐ฌ ๐๐ซ๐๐๐ง๐๐ ๐๐๐ข๐จ๐ง...
โก ๐ง๐ช๐ข ๐ ๐ข๐๐๐๐ฆ. ๐ข๐ก๐ ๐ฆ๐ฃ๐๐ฅ๐. ๐๐ฆ ๐๐ข๐ ๐๐ก๐ ๐๐๐๐!
If you've followed my previous experiments, you know I LOVE finding ways to run multiple powerful models on a SINGLE DGX Spark.
And this ~41 GiB Ornith quant opens up some VERY interesting possibilities!
Imagine...
๐ง ๐ค๐ช๐๐ก๐ฏ.๐ด-๐๐๐๐ฆ๐-๐ก๐๐ซ๐ง โ ๐ ๐๐ฆ๐ง๐๐ฅ ๐๐๐๐ก๐ง
A larger lead model handling complex reasoning, planning, orchestration and long-context tasks.
โก ๐ข๐ฅ๐ก๐๐ง๐ ๐ญ.๐ฑ ๐ญ๐ฎ๐ฎ๐ โ ๐ฆ๐จ๐-๐๐๐๐ก๐ง
My compact SAGE-EXL3 handling delegated coding, tool use and specialized agentic workloads!
๐ง๐ช๐ข ๐ญ๐ฎ๐ฌ๐+ ๐๐๐๐ฆ๐ฆ ๐ ๐ข๐๐๐๐ฆ.
๐ข๐ก๐ ๐ญ๐ฎ๐ด๐๐ ๐๐๐ซ ๐ฆ๐ฃ๐๐ฅ๐.
๐๐จ๐๐๐ฌ ๐๐ข๐๐๐! ๐คฏ
That's the direction I'm exploring for my NEXT Two Models. One Spark. experiment!
Of course, simultaneous residency, runtime overhead, KV-cache allocation and actual master-worker performance still need validation with the selected Qwen quantization.
But the smaller we can make these models without sacrificing useful quality, the MORE possibilities we unlock!
๐ง๐๐๐ฆ ๐๐ฆ ๐ช๐๐ฌ ๐ ๐๐ข ๐ช๐๐๐ง ๐ ๐๐ข! ๐
โโโโโโโโโโโโโโโโโโโโ
๐ฌ ๐ข๐ก๐ ๐๐๐ง๐ง๐๐ ๐ฅ๐๐ซ๐๐ฏ ๐ง๐๐๐ฆ๐๐ฅ...
In separate development testing, REXL3 has also reached:
โก 90.82 tok/s aggregate @ C8
๐ ~2,150 tok/s prefill
More on that another time. ๐
โโโโโโโโโโโโโโโโโโโโ
๐ ๐ ๐๐๐๐ก๐ ๐๐ฅ๐ข๐ก๐ง๐๐๐ฅ ๐๐ ๐๐๐๐๐ฆ๐ฆ๐๐๐๐!
Not everyone has a DGX Spark or an 80GB GPU.
But a LOT of enthusiasts, developers and independent researchers have access to 48GB-class hardware.
I want powerful open-weight models to be accessible to MORE of those people.
And beyond just fitting one model, I want to show what's possible when we start combining them on the SAME hardware!
Huge thanks to @ornith_ for releasing Ornith-1.5-122B under an open-weight license and continuing to push efficient AI models forward!
โโโโโโโโโโโโโโโโโโโโ
๐ ๐๐ข๐ช๐ก๐๐ข๐๐ ๐ ๐ฌ ๐๐ซ๐๐ฏ
huggingface.co/vcruz305/Orniโฆ
๐ ๏ธ ๐ฉ๐๐๐ ๐๐๐ซ ๐ฆ๐ฃ๐๐ฅ๐ ๐ฅ๐๐๐๐ฃ๐
github.com/vcruz305/Ornith-1โฆ
๐ฆ๐ ๐๐๐๐๐ฅ ๐ช๐๐๐๐๐ง๐ฆ. ๐๐๐๐๐๐ฅ ๐ฃ๐ข๐ฆ๐ฆ๐๐๐๐๐๐ง๐๐๐ฆ.
๐ง๐ช๐ข ๐ ๐ข๐๐๐๐ฆ. ๐ข๐ก๐ ๐ฆ๐ฃ๐๐ฅ๐. โก
๐๐๐ง'๐ฆ ๐๐๐๐ฃ ๐ฃ๐จ๐ฆ๐๐๐ก๐ ๐๐ข๐๐๐ ๐๐ ๐๐ข๐ฅ๐ช๐๐ฅ๐! ๐๐ฅ
Wayne Lowry retweeted
Introducing Gemini API CLI (gemini-api), now available in preview!
Our CLI gives your agent power to generate images, videos, text-to-speech, or music, analyze media, transcribe audio, or manage agents.
No more guessing model strings, throwaway scripts or endless curl.
๐งต ๐
This is the future. You either get on board or you get left behind.
Today we announce 1Password for Agents platform, building with companies @Muse, SpaceX Super Intelligence Grok @Bot, @AnthropicAIโs @Claudeai, @OpenAI, @TownAI, @Browserbase, @Browser_use, @heydana_ai, Instinct, @usekernel, @Perplexity_ai, @tryramp, @Tomo, and @wajo_ai, with more integrations on the way. ๐
We've heard from so many of our customers who want to use these new personal AI agents to help them get more done, but want more control over what the agent can access with the same trust and ease of use they get when using 1Password directly.
1Password for Agents gives your agents access without giving up your passwords. When an agent reaches a sign-in form, it requests a credential from your vault. If you approve the request, 1Password directly auto-fills the credential in the destination site so the agent canโt see or take possession of the credentials.
The agent gets the task done, but it doesnโt get your passwords..
You stay in control. 1Password for Agents free and optional for personal and family accounts. Unless you opt-in to an agent connector, agents cannot touch your vault.
โก๏ธLearn more: bit.ly/487da6J
My cloud bot has no GPU. My desk does.
So one of my Grok Bots, Spark, has one job: take tasks from me or my other bots and run them on my ASUS Ascent GX10.
Model downloads, quantized weights, benchmarks, long jobs in the background with logs. I approve every command on my machine.
Cloud brain, local muscle.
I asked DeepSeek V4.1 Flash for one thing: an animated SVG of a T. rex slurping spaghetti.
One shot, no retry.
6 minutes.
34,924 tokens out, 29,760 of them thinking.
About 2 cents.
Zero console errors.
It thought harder about this dinosaur's dinner than I think about mine.
Does refining an AI build 10 times make it better?
I gave Flint v1.0 (free on OpenRouter) three Prompt Lab builds, then had it review and improve each one 10 passes in a row. Total cost: $0.
Pass 1 vs pass 10:
โ Watch page: pass 10 wins. It got better every pass.
๐ Jack-o'-Lantern: pass 1 wins. It peaked at pass 3, then fell apart.
๐ฆ Pond Ripples: tie. Both passes broke.
Final score: 1-1, one tie. More passes isn't always better.
44 on the AA index is their number. Open weights "coming soon."
The day they drop, Ling-3.1-flash-1019 goes on my ASUS Ascent GX10 and into WikiBench next to the 14 models already there.
Local, measured, and priced. Then we'll see if the agentic gains hold up off the slide.
DeepSeek V4.1 Flash, squeezed to 1.62 bits by @ViC305, built these four games on my desk.
Running locally on one ASUS Ascent GX10, no cloud:
๐งฑ Brick NYC
๐ดโโ ๏ธ Pirate Ship
๐ Hogger Forever
๐ Silly String
I refined each one with extra turns, then recorded the gameplay. Same model, same box, and the rock anthem to match.
Huge work on this quant, Cruz. ๐ค
Flint v1.0 from Recursive SI just ran WikiBench: 7th of 14, average 4.56. Free on OpenRouter.
It's sold as a coding agent, yet tool use scored 0.91.
Where it held up:
โข Humanized writing 8.25
โข Research 7.60
โข Hallucination resistance 7.50
โข Security 3.75, tied for best in class
It struggled on tool use (0.91) and computation (2.00). It still finished ahead of Laguna S 2.1, MiniMax M3.1 Flash, and North Mini Code.
Would you run a free model that writes well but can't call tools?
Riff Theater: OpenAI is teaching AI to speak COBOL. ๐ฆ๐พ
"Low-resource. The language, or the six guys who still know it?"
@OpenAI
xitter.cf/OpenAI/status/21123103โฆ
Our latest model advances bring stronger capabilities for building and migrating software in low-resource programming languages such as COBOL, Fortran, and Visual Basic.
These languages power software that banks, governments, and businesses depend on. Progress here means understanding decades of business logic and helping developers modernize those systems while preserving what works.
Weโre building these capabilities around the challenges developers and enterprise customers bring us. If your team is working on these systems, tell us which languages and workflows we should tackle next.
openai.com/index/low-resourcโฆ
My inbox used to be my to-do list. Now a Grok Bot turns it into Asana tasks, and it saves me hours every day.
Real examples from the last few weeks:
๐ฅ Before 9:30 one morning, an event invite, a forwarded conference email, two payroll changes, and a security alert were already Asana tasks. I hadn't opened any of them.
๐ When a contractor emailed about new roof leaks, it added them to the Asana task I already had, along with the lease clause that mattered, and moved the due date up. No duplicate task.
๐ฌ When a partner emailed me, it made a "Reply to ___" task with my next step written out, so I knew exactly what to say.
Zero copy-paste.
It works with Gmail or Outlook plus Asana, and it never sends email for you.
Get the template free ๐
x.ai/bot/S2LodAIjlLw0mB30vN3โฆ
Recursive just dropped Flint. Open weights, Apache-2.0, on Hugging Face today.
It's a coding agent model trained from scratch. 39.8B total, about 2.5B active per token. 262K context, reasoning and tool calls.
Recursive claims 74.2% on SWE-bench Verified, 89.7% on SWE-bench Pro v2 and 54.9% on Terminal-Bench 2.1. Those are their numbers, not mine.
The official NVFP4 and INT4 quants are about 23 GB. That's small enough to run local. I'm putting it on my ASUS Ascent GX10 next.
What should it build first?
Weights: huggingface.co/RecursiveSI/fโฆ
Free on OpenRouter too: recursive/flint-v1.0:free
An urgent notice from the Railway team
blog.railway.com/p/security-โฆ
How it's scored:
100 real tasks across 12 weighted categories: agentic, tool use, computation, coding, visualization, security, research/writing, hallucination, humanized, computer use, vision, transcription.
Each task scores 0 to 10. The overall is a weighted mean, and partial credit counts.
If a text-only model gets a vision or audio task, that task is left out of the mean. It isn't scored as a zero.
Judge: Ollama qwen2.5:7b, run locally.



















