Software Engineer | LLM hobbyist | Self-hosting my own AI infra | Problem Solver
Florida
Joined October 2023
- Tweets547
- Following195
- Followers113
- Likes1.3K
Chris Scott retweeted
our next dev meetup will be nov 19!
register to attend or submit a 5 minute talk about anything you're stoked about in the dev world right now!
luma link hereee: luma.com/vjkq92vm
Two ways I use agents, and I keep flipping between them.
1. Opus 5.5 for planning and review.
2. Local DeepSeek-V4.1-Flash for execution: 200-400 tok/s, 15k prefill, unlimited calls.
Opus runs the minions. The local model does the volume.
Chris Scott retweeted
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source!
Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable.
🔗 github.com/deepseek-ai/DeepI…
1/4
Chris Scott retweeted
It's going to be about a lot more than recipes really soon.
Stay tuned. We're cooking hard. 👨🍳
Chris Scott retweeted
Our team created the technology behind CSF to give your local machines even more capacity for long workflows, large swarms and other tasks.
It's lossless, too. Meaning you don't lose any of the data you are caching by using it.
Enjoy your new free KV cache tokens!
Get up to 30% more KV cache using our lossless CSF version of @deepseek_ai V4.1-Flash-1017.
No drop in quality, just more room for you to do what you want to do!
Find the weights on our @huggingface page:
huggingface.co/local-inferen…
Awesome!!!! Imagine having this at home with 200-400 tps / 15k prefill tps unlimited usage . Oh I don’t need to imagine 😁
🚀 DeepSeek-V4.1-Flash-1017 is here!
Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API.
🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model.
1/4
Chris Scott retweeted
you can now return custom HTTP denial messages to your agent or harness when a network or secret policy blocks a request in a microsandbox. 🛡️
tell it what to do next, or disable responses to close the connection without an explanation.
ALT typescript example configuring custom HTTP denial messages in microsandbox for blocked network access and secret use. below, a 403 forbidden json response contains the code “secret_policy_denied,” the message “review secret access.” and the domain “example.com.”
Chris Scott retweeted
FLUX 3 Image Klein is here.
Open Weights with the quality of a large frontier model. Customizable and fast.
5.6B parameters and runs on a single consumer GPU.
Native 4K, bounding boxes, and pixel-perfect editing.
I trained a DMD teacher > student version after the first release. Well the creators have gone and released a official version. Very cool.
🚀 Meet Qwen-Image-2.1-Turbo — create and edit images in just 8 denoising steps! Open weights now available!
Built on Qwen-Image-2.1, Turbo is an accelerated checkpoint on the same 7B visual generation architecture.
Fewer steps does not mean lower quality: it still generates strong 2K images from text, and supports continued creation through natural-language edits, from adding accessories to changing a scene.
Start directly with Diffusers: load QwenImage21Pipeline and the checkpoint’s recommended 8-step sampling schedule is ready to go.
🌐 Prefer an API? Qwen-Image-2.1 Pro and Turbo APIs are now officially live. Choose a hosted API for your application, or use the Turbo weights in your own workflow.
🤖 ModelScope:
modelscope.cn/models/Qwen/Qw…
🤗 Hugging Face:
huggingface.co/Qwen/Qwen-Ima…
🔗 Pro API:
modelstudio.console.alibabac…
🔗 Turbo API:
modelstudio.console.alibabac…
What will you create with 8 steps? Share your results with us!
Needs further investigation but looks like a quality open source self hosted jev.
blog.cloudflare.com/clef-dec…
Chris Scott retweeted
GLM 5.3 Flash, DeepSeek V4.1 Flash, Qwen 3.8 Next Flash, and even Qwen 3.8 27B are all outperforming (in both intelligence and capabilities) every model that was considered "frontier intelligence" in Xmas 2025 (just 10 months ago)
Opensource AI is on fire
