AI Engineering Current: vibe-deploying @pocketmodelai to prod Prev: OpenAI, Netflix, Uber

Latent Space
Joined July 2007
8 agents running DeepSeek-V4.1-Flash at once at ~40-50tps, All 8 are served from one used 8x V100 server running a custom a Rust + CUDA engine. This is about $0.20–0.25 per million output tokens on a spot-rented marketplace box.
3
2
13
704
Model release volume is superseding the CVE volume
Introducing Kimi K3.1 Pro: our most capable 3T-class open-weight model. 🔹 1M-token context, 2.8T total / 104B active params (MoE), Multimodal. 🔹 Full-project coding: games in Unreal, Unity & Godot. 🔹 Excels at parametric 3D modeling in Blender & CAD. 🔹 More reliable at finance work: Accurate modeling with hallucination down by 65%. 🔹 Matching the strongest proprietary models across coding, agentic and knowledge benchmarks. Kimi K3.1 Pro and K3.1 Pro Highspeed (2–3× faster) are now live on Kimi.ai, Kimi Work, Kimi Code, and the Kimi API. Open weights by Nov 4, 2026. 🔗 API: platform.kimi.ai 🔗 Tech blog: kimi.ai/blog/kimi-k3-1-pro
1
1
146
Aleksey Smolenchuk retweeted
Introducing Kimi K3.1 Pro: our most capable 3T-class open-weight model. 🔹 1M-token context, 2.8T total / 104B active params (MoE), Multimodal. 🔹 Full-project coding: games in Unreal, Unity & Godot. 🔹 Excels at parametric 3D modeling in Blender & CAD. 🔹 More reliable at finance work: Accurate modeling with hallucination down by 65%. 🔹 Matching the strongest proprietary models across coding, agentic and knowledge benchmarks. Kimi K3.1 Pro and K3.1 Pro Highspeed (2–3× faster) are now live on Kimi.ai, Kimi Work, Kimi Code, and the Kimi API. Open weights by Nov 4, 2026. 🔗 API: platform.kimi.ai 🔗 Tech blog: kimi.ai/blog/kimi-k3-1-pro
820
2,015
1,555
18,701
1,336,306
The answer to life and everything is a rigorous self improvement agentic harness setup
7
339
Not an apples-to-apples comparison, but you can also get it to do 3000+ toks/s (total) on a 9-year old machine.
DeepSeek V4.1 Flash 1017 runs at 1,521+ tok/s on Fireworks Ultrafast. Fast enough to ship Tetris in 11 seconds, 7x faster than Claude Opus 5.5. Join the Ultrafast waitlist: bit.ly/3UA0wKq
1
5
220
Aleksey Smolenchuk retweeted
Frontier labs are advancing the capabilities in AI for biology but preventing the good guys (scientists, academia, non-profits, health agencies,...) to use, study and understand it with widespread but shallow guardrails that the bad guys are bypassing easily (blocked me to proofread this tweet for example 😅). This will automatically create massive assymetry and risks in the coming years, just like in cybersecurity, especially now that frontier labs are building wet labs (HF cybersecurity scenario for biology when?). This is why we created Carbon-X, the best open-source DNA model by midtraining Qwen3-14B on 300B tokens of DNA, English and interleaved data. We also used a hybrid tokenizer that tokenizes English with BPE and DNA with a 6-mer tokenizer. As a result, Carbon-X outperforms all open language models we evaluated on five benchmarks of DNA understanding and generation. This is a 27-point improvement over Qwen3-14B, showing how much a language model can gain from DNA training. It is also API frontier level at 1,800x less cost than GPT 6.1 Sol! We hope Carbon-X helps researchers explore DNA in new ways. Releasing it openly means anyone can study its capabilities, limitations, and risks. Let's make the AI biology frontier open-source to make it safe and impactful for the whole world (not just a few companies). Apache 2.0 Model on @huggingface: huggingface.co/HuggingFaceBi…
74
156
21
1,234
83,241
The notion that “a compiler has already optimized the code for you” could not be more wrong
2
227
next cve number is gonna be quads
3
465
DeepSeek-V4.1-Flash on an old gaming desktop with two RTX 3090s and 128 GB of DDR4 RAM, using a custom exl3-like trellis quantization to squeeze more out of the CPU experts. Making a snake game. Decode at about 35 tok/s. huggingface.co/lxe/DeepSeek-… github.com/lxe/dsx
5
474
I'm gonna make it faster and cheaper
1
1
59
Aleksey Smolenchuk retweeted
running 552b deepseek-v4.1-flash-1017 on two rtx 3090s + 128gb ram? @lxe's dsx keeps hot experts in vram and cold t16 experts in ram for 34.9 tok/s decode (36.8 with --defer-rank 3). mit-licensed; needs cuda 13 and ~305gb nvme. github.com/lxe/dsx
1
1
3
85
Let's see if this is direction is worth it. EXL3's trellis with CPU-friendly codebook for fast decoding on both CPU and GPU, damping against overfit, output-gain correction, 1.5-2.5 bit layout.
2
168
Having trouble defining the modern AI speech cadence? > You open the fridge. Same shelves. Less possibility. The leftovers hold yesterday. The empty space holds the decision. That’s where dinner begins. Tell your agent to stop using “Asyndetic parataxis with referential ellipsis and repeated rhetorical closure.”
1
1
184
gm, what's today's cve?
2
2
271
Aleksey Smolenchuk retweeted
Project Maya v1.1.22 is out 🚀 🐳 DeepSeek-V4.1-Flash-1017 now runs fully in a 128GB PC ⚡Several performance gains accross the board (+++decode and pp) Full details 👇 github.com/mw00/project-maya…
28
54
13
548
57,346
This is it. This is the missing model. @Recursive_SI Flint is a modern MoE sized for the hardware people actually have: 40B total with ~2.5B active per token, so it fits a 24 GB Mac or a single consumer GPU and decodes incedibly fast - 256 routed experts, 6 per token, plus a shared expert - 262K context, reasoning and tool calling - Apache 2.0, - 125+ tok/s on an M4 Pro MacBook Pro - people already have it running on a single RTX 3060 at ~46 tok/s - I bet unsloth has dynamic quants for this already Running it against Qwen3.6-35B-A3B in @pocketmodelai now; results soon.
Watch an eval of @Recursive_SI's Flint head-to-head with Qwen3.6-35B-A3B, on @pocketmodelai. It researches both models, builds a JavaScript coding eval from MultiPL-E HumanEval, writes a code grader that runs each answer against its tests, and compares accuracy, speed and cost
1
4
439
Aleksey Smolenchuk retweeted
Watch an eval of @Recursive_SI's Flint head-to-head with Qwen3.6-35B-A3B, on @pocketmodelai. It researches both models, builds a JavaScript coding eval from MultiPL-E HumanEval, writes a code grader that runs each answer against its tests, and compares accuracy, speed and cost
Introducing Flint, @Recursive_SI’s first model: a fast local coding model built with our automated research system, the Eureka Machine. • Best-in-class fast local coding • Up to 2x faster than comparable models: 125+ tokens/sec on a MacBook Pro, 150+ on RTX Spark • Built from scratch in under 4 months Private, unmetered intelligence on your own machine. Open weights available now on @huggingface, run it locally on your favorite framework or try it for free on @opencode or @pidotdev.
1
1
1
1
494