the numbers were a little unbelievable at first
we’ve trained what we believe is the most effective model router for coding tasks on the market. and we have the benchmarks to back it up.
on our benchmarks, Baseten Router cut costs by 72% compared to using Opus 5.5 for every task, with a pass rate just 0.8 percentage points lower.
i’m especially proud of how empirical @mblau_ @gmtroadec and the team were. they challenged our own early wins and kept pushing on how we measured progress.
a lot of science goes into routing, but our goal is to maximize task success while minimizing cost per task.
you can access this now through Baseten Grid, in public preview
Introducing Baseten Grid: gateway, intelligent routing, and guardrails in one layer, so enterprises get more done with their AI spend.
Grid is a single layer to route requests, monitor usage, and govern access across all your coding agents. Used and loved by teams like @Opendoor along with our own, Grid helps cut AI coding costs without changing how developers work.
Join the waitlist here: baseten.co/talk-to-us/reques…
🤖 Made with AI
Inference, training, routing, governance, and sandboxes are the building blocks of every AI product today.
We’ve learned a lot from our customers about what it takes to build that system well: @OpenEvidence trains models that outperform the closed frontier, then serves them on Dedicated Inference. @datadoghq post-trains on Loops. @Opendoor routes every AI request across the company through Grid.
This week we have three launches expanding our inference platform:
- Grid: gateway, intelligent router, and guardrails for every model your company uses (launching tomorrow)
- Sandboxes: stateful, VM-isolated environments for agents that scale to thousands of instances in seconds (launching Thursday)
- Loops: serverless SFT and RL on open-weight models, deployable straight to Dedicated Inference (GA Friday)
@amiruci, @saimaddali, @paul_s3i, and @oneill_c break down what we're launching. You might notice the visuals have a new look as well.
Ben Bleikamp retweeted
We're doing 3 launches this week, expanding Baseten's inference platform:
- Grid: gateway, intelligent router, and guardrails for coding agents (launching on Wednesday)
- Sandboxes: stateful, VM-isolated, and co-located with inference (launching on Thursday)
- Loops: serverless RL and SFT on frontier open-weight models (GA on Friday)
What excites me most is bringing training, inference, routing, and execution onto the same platform and showing what becomes possible when they're built to work together.
More to come all week.
Today we release mammoth-1 and elephant-1!
We post-trained mammoth-1, the #1 ranked best decision model in the world, and elephant-1, which is the best model under 15B (and beats Jev).
We're open-sourcing all model weights and provide a technical report detailing all our training and data methods.
Ben Bleikamp retweeted
Two months ago I said the easiest way to use open models in Codex was `brew install baseten-switch`. Starting today you don't need baseten-switch: Baseten is the first inference provider in the new OpenAI B2B Marketplace. Enterprise OpenAI customers can run open models on Baseten natively via Codex and the Responses API.
baseten.co/blog/baseten-open…
Today we're announcing Base Labs, a dedicated research organization focused on advancing open-source AI.
We believe in a healthy, open frontier model ecosystem. To enable this, we are working on:
- Blue-sky research on continual learning, the science of RL, and how models learn across their full lifecycle, with every experiment and recipe shared openly.
- The BaseHub Data Foundry: the highest-quality open RL environments, training data, and real-world benchmarks, built for anyone to train and benchmark on.
- Post-post training: taking open-source models and making them better, safer, and more aligned through continual post-training, built on our research, and deployed with our frontier safety stack so organizations can use open-source models with confidence.
- Making models cheaper and more performant through our model performance research.
This is a mission-driven research effort, not a commercial product. We believe the health of the open-source AI ecosystem matters and that the best way to advance it is to do science in the open.
We’re hiring engineers, researchers, and research fellows to advance this mission.
labs.baseten.co/
Today, we're announcing Baseten for Model Labs.
We believe the AI landscape will be made up of a diverse ecosystem of specialized, closed-weight models running alongside open-weight ones.
Baseten for Model Labs is the platform built to enable labs to monetize, distribute, and scale their closed models on Baseten infrastructure.
Ben Bleikamp retweeted
The GLM moment is going to be bigger than the DeepSeek moment.
Baseten has the fastest inference on the best open-weight model. >280 tps and <0.8 ttft.
Ben Bleikamp retweeted
Email isn’t going anywhere. It’s just going to get a whole lot better.
Introducing Sutro—an email client designed for people and their agents. Bring your own Claude, Codex, or OpenClaw agents and have them work with you directly in your inbox.
the most impressive thing about zclaw is that @tnm figured out how to make a documentation site without React
Wrote up more on how to play with zclaw:
- helpful local dev env. zclaw ships with tools for debugging & building (agents like 'em). zclaw.dev/local-dev.html
- real use cases, serious & fun. and why they are interesting on a limited, physical board. zclaw.dev/use-cases.html
Ben Bleikamp retweeted
Introducing Agentation: a visual feedback tool for agents. Available now: ~npm i agentation
Click elements, add notes, copy markdown. Your agent gets element paths, selectors, positions, and everything else it needs to find and fix things.
Link to full docs below ↓
This is just software development?
Ben Bleikamp retweeted
We figured out a new way to work with infra data: not old static dashboards, not “AI on every click” chaos.
But generative UI with structure.
Cased generates a controller, validates it, then runs real data: fast & predictable. AI does the thinking, UX stays fast. Check it out:
Ben Bleikamp retweeted
generative (and extremely fast) infra dashboards for you
Ben Bleikamp retweeted
coming very, very soon from Cased:
generative, context-aware dashboards for every single deploy. aware of previous deploys. knows your system, knows all your integrations.
the exact info you care about it. don't guess at what you need.
Ben Bleikamp retweeted
Cased develops AI agents that assist you in debugging production issues.
Now, you can connect your @runcased and Render accounts to create automatic platform workflows triggered by Render events!
New in Cased today 🚢
Connect with @render to trigger Cased Agents: automatically respond to deployment failures, performance issues, and scaling events.
We also buffed up our Render metrics integration, so you can get detailed CPU, memory, and DB data.
cased.com/blog/2025-12-01-re…





























