
AI Engineering Current: vibe-deploying @pocketmodelai to prod Prev: OpenAI, Netflix, Uber
Latent Space
Joined July 2007
- Tweets8.5K
- Following1.9K
- Followers2.9K
- Likes16.5K
Pinned Tweet
8 agents running DeepSeek-V4.1-Flash at once at ~40-50tps,
All 8 are served from one used 8x V100 server running a custom a Rust + CUDA engine.
This is about $0.20–0.25 per million output tokens on a spot-rented marketplace box.
Model release volume is superseding the CVE volume
Introducing Kimi K3.1 Pro: our most capable 3T-class open-weight model.
🔹 1M-token context, 2.8T total / 104B active params (MoE), Multimodal.
🔹 Full-project coding: games in Unreal, Unity & Godot.
🔹 Excels at parametric 3D modeling in Blender & CAD.
🔹 More reliable at finance work: Accurate modeling with hallucination down by 65%.
🔹 Matching the strongest proprietary models across coding, agentic and knowledge benchmarks.
Kimi K3.1 Pro and K3.1 Pro Highspeed (2–3× faster) are now live on Kimi.ai, Kimi Work, Kimi Code, and the Kimi API.
Open weights by Nov 4, 2026.
🔗 API: platform.kimi.ai
🔗 Tech blog: kimi.ai/blog/kimi-k3-1-pro
Aleksey Smolenchuk retweeted
Introducing Kimi K3.1 Pro: our most capable 3T-class open-weight model.
🔹 1M-token context, 2.8T total / 104B active params (MoE), Multimodal.
🔹 Full-project coding: games in Unreal, Unity & Godot.
🔹 Excels at parametric 3D modeling in Blender & CAD.
🔹 More reliable at finance work: Accurate modeling with hallucination down by 65%.
🔹 Matching the strongest proprietary models across coding, agentic and knowledge benchmarks.
Kimi K3.1 Pro and K3.1 Pro Highspeed (2–3× faster) are now live on Kimi.ai, Kimi Work, Kimi Code, and the Kimi API.
Open weights by Nov 4, 2026.
🔗 API: platform.kimi.ai
🔗 Tech blog: kimi.ai/blog/kimi-k3-1-pro
Not an apples-to-apples comparison, but you can also get it to do 3000+ toks/s (total) on a 9-year old machine.
DeepSeek V4.1 Flash 1017 runs at 1,521+ tok/s on Fireworks Ultrafast.
Fast enough to ship Tetris in 11 seconds, 7x faster than Claude Opus 5.5.
Join the Ultrafast waitlist: bit.ly/3UA0wKq
Aleksey Smolenchuk retweeted
Frontier labs are advancing the capabilities in AI for biology but preventing the good guys (scientists, academia, non-profits, health agencies,...) to use, study and understand it with widespread but shallow guardrails that the bad guys are bypassing easily (blocked me to proofread this tweet for example 😅).
This will automatically create massive assymetry and risks in the coming years, just like in cybersecurity, especially now that frontier labs are building wet labs (HF cybersecurity scenario for biology when?).
This is why we created Carbon-X, the best open-source DNA model by midtraining Qwen3-14B on 300B tokens of DNA, English and interleaved data. We also used a hybrid tokenizer that tokenizes English with BPE and DNA with a 6-mer tokenizer.
As a result, Carbon-X outperforms all open language models we evaluated on five benchmarks of DNA understanding and generation. This is a 27-point improvement over Qwen3-14B, showing how much a language model can gain from DNA training. It is also API frontier level at 1,800x less cost than GPT 6.1 Sol!
We hope Carbon-X helps researchers explore DNA in new ways. Releasing it openly means anyone can study its capabilities, limitations, and risks. Let's make the AI biology frontier open-source to make it safe and impactful for the whole world (not just a few companies).
Apache 2.0 Model on @huggingface: huggingface.co/HuggingFaceBi…
Hello top 10 gang 👋
We're launching a $100,000 challenge to see who can make Muse Spark run fastest: openkernelchallenge.dev/
Aleksey Smolenchuk retweeted
hey ma, look who is behind me on the leaderboard
We're launching a $100,000 challenge to see who can make Muse Spark run fastest: openkernelchallenge.dev/
DeepSeek-V4.1-Flash on an old gaming desktop with two RTX 3090s and 128 GB of DDR4 RAM, using a custom exl3-like trellis quantization to squeeze more out of the CPU experts.
Making a snake game. Decode at about 35 tok/s.
huggingface.co/lxe/DeepSeek-…
github.com/lxe/dsx
Aleksey Smolenchuk retweeted
running 552b deepseek-v4.1-flash-1017 on two rtx 3090s + 128gb ram? @lxe's dsx keeps hot experts in vram and cold t16 experts in ram for 34.9 tok/s decode (36.8 with --defer-rank 3). mit-licensed; needs cuda 13 and ~305gb nvme. github.com/lxe/dsx
Let's see if this is direction is worth it. EXL3's trellis with CPU-friendly codebook for fast decoding on both CPU and GPU, damping against overfit, output-gain correction, 1.5-2.5 bit layout.
Having trouble defining the modern AI speech cadence?
> You open the fridge. Same shelves. Less possibility. The leftovers hold yesterday. The empty space holds the decision. That’s where dinner begins.
Tell your agent to stop using “Asyndetic parataxis with referential ellipsis and repeated rhetorical closure.”
Aleksey Smolenchuk retweeted
Project Maya v1.1.22 is out 🚀
🐳 DeepSeek-V4.1-Flash-1017 now runs fully in a 128GB PC
⚡Several performance gains accross the board (+++decode and pp)
Full details 👇
github.com/mw00/project-maya…
This is it. This is the missing model.
@Recursive_SI Flint is a modern MoE sized for the hardware people actually have: 40B total with ~2.5B active per token, so it fits a 24 GB Mac or a single consumer GPU and decodes incedibly fast
- 256 routed experts, 6 per token, plus a shared expert
- 262K context, reasoning and tool calling
- Apache 2.0,
- 125+ tok/s on an M4 Pro MacBook Pro
- people already have it running on a single RTX 3060 at ~46 tok/s
- I bet unsloth has dynamic quants for this already
Running it against Qwen3.6-35B-A3B in @pocketmodelai now; results soon.
Watch an eval of @Recursive_SI's Flint head-to-head with Qwen3.6-35B-A3B, on @pocketmodelai.
It researches both models, builds a JavaScript coding eval from MultiPL-E HumanEval, writes a code grader that runs each answer against its tests, and compares accuracy, speed and cost
Aleksey Smolenchuk retweeted
Watch an eval of @Recursive_SI's Flint head-to-head with Qwen3.6-35B-A3B, on @pocketmodelai.
It researches both models, builds a JavaScript coding eval from MultiPL-E HumanEval, writes a code grader that runs each answer against its tests, and compares accuracy, speed and cost
Introducing Flint, @Recursive_SI’s first model: a fast local coding model built with our automated research system, the Eureka Machine.
• Best-in-class fast local coding
• Up to 2x faster than comparable models: 125+ tokens/sec on a MacBook Pro, 150+ on RTX Spark
• Built from scratch in under 4 months
Private, unmetered intelligence on your own machine. Open weights available now on @huggingface, run it locally on your favorite framework or try it for free on @opencode or @pidotdev.





















