Crwla (@datameadow) profile picture

Reposts are recreational. All opinions shared are mine.

Globetrotter.
Joined July 2015
Photo by Crwla (@datameadow)Photo by Crwla (@datameadow)Photo by Crwla (@datameadow)Photo by Crwla (@datameadow)Photo by Crwla (@datameadow)Photo by Crwla (@datameadow)Photo by Crwla (@datameadow)Photo by Crwla (@datameadow)Photo by Crwla (@datameadow)Photo by Crwla (@datameadow)
Crwla retweeted
Replying to @datameadow
Love this! Reading "43(1)(b)" correctly is harder than the model itself haha. Added to the README :))
1
1
1
59
Crwla retweeted
You learn something new every day on this app There's so much cool mechinterp research that would otherwise fly under my radar goodfire.com/research/interp…
Replying to @neural_avb
I would add that SAEs show weaknesses like feature splitting that newer methods like VPD solve. Basically they make stuff up by design. Still, I'm not convinced that we can get the whole picture without accounting for some degree of superposition on certain features.
1
15
233
8,058
You can now run Laya Decision models locally on just 4GB RAM! 🔥 Works on CPU, Mac, Windows, Linux and GPU setups. Serve Laya through a Jev-compatible API via Unsloth Desktop. GitHub: github.com/unslothai/unsloth Guide: unsloth.ai/docs/models/decis…
71
314
35
2,420
157,523
Took a while, but here it is, a mega write-up on language models for text classification and, of course, Jev. It's basically a visual guide to RNNs, CNNs, transformers, and calibration, with hands-on experiments on accuracy and efficiency.
81
335
17
2,460
158,474
Bend 2 is here! It is a new programming language that blocks AI mistakes via *proof checking* - the same technique big AI labs used to solve open math problems, like Navier-Stokes. It is also very fast, and runs on GPUs. Watch the video. Link in the comments.
RELEASE DAY After almost 10 years of hard work, tireless research, and a dive deep into the kernels of computer science, I finally realized a dream: running a high-level language on GPUs. And I'm giving it to the world! Bend compiles modern programming features, including: - Lambdas with full closure support - Unrestricted recursion and loops - Fast object allocations of all kinds - Folds, ADTs, continuations and much more To HVM2, a new runtime capable of spreading that workload across 1000's of cores, in a thread-safe, low-overhead fashion. As a result, we finally have a true high-level language that runs natively on GPUs! Here's a quick demo:
671
1,337
358
11,970
2,241,740
Crwla retweeted
i shed a tear reading this blog post by a deepseek kernel engineer
63
460
61
6,708
212,043
Crwla retweeted
🚀Qwen3.8-27B flies on a laptop, becoming part of our work and daily lives. Thanks for the shoutout! @atomic_chat_hq
Run Qwen3.8 27B locally via Atomic Chat💥 We released Atomic Dynamic GGUF quants, from 8-bit (28.9 GB) down to 1-bit (8.5 GB), and measured all other Qwen3.8 GGUFs in the community AD-IQ3_S runs on a 16GB MacBook Air and picks the same next token as the BF16 original 92.4% of the time
82
130
14
1,977
201,968
Crwla retweeted
Qwen 3.8 35B A3B almost confirmed! Spotted on github! while everyone's busy swapping qwen3.6 27b for the new qwen3.8 27b dense drop on their single rtx 4090s and 3090s, the real quiet update is buried in this github commit: 35B total, ~3B active. same MoE recipe that made qwen3.6 35b a3b a favorite for 8-16GB VRAM setups. not officially announced yet, just sitting in the supported models table. if the pattern holds, weights drop soon. gpu poor gang, this is your sign It has been spotted at github.com/modelscope/ms-swi… This commit (ab726e9) in the modelscope/ms-swift repository is associated with the addition of support for the Qwen3.8 model family
101
168
77
1,839
172,714
Crwla retweeted
anthropic: if we release this humanity might end. qwen: here is god in a zip file please star our repo
Meet Qwen3.8-Max: A New Bar for Coding and Cowork.
131
1,525
44
28,771
1,515,771
For my first post, I’m sharing a letter @NVIDIA signed on why open models matter. AI will transform every industry, power every company, and be built by every country. Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. The world needs both frontier closed models and frontier open models. images.nvidia.com/pdf/Open-W…
16,553
34,451
12,078
193,801
69,452,139
I was studying MCPs and this comment really blew my mind.
157
911
152
12,260
366,975
Crwla retweeted
goldmine for ML Systems learning bodunhu.com/blog/posts/machi…
2
36
465
26,951
We're hiring a Research Engineer at @Arsenal ⚽🔴⚪ to work directly with our Men's First Team! We're building state-of-the-art AI models for the football domain. This role will focus on building the application layer for our research to advance coaching and analysis workflows.
428
1,293
573
15,709
2,899,089
Crwla retweeted
Introducing Antares: @Cisco's family of small language models for locating known vulnerabilities in code. Antares-350M and Antares-1B are live on Hugging Face now. They can outperform many larger closed- and open-weight models at a fraction of the cost. Small enough to run locally. No shipping sensitive codebases to the cloud. Why it matters: vulnerability triage is expensive and slow. Antares helps democratize AI-assisted security for all. Explore the models + read the new Vulnerability Localization Benchmark: blogs.cisco.com/ai/introduci…
60
233
70
1,923
530,047
You don't even want to know what sending 80,000 emails would cost you in 1 week. Postmark: $100+ SendGrid: $90+ Resend: $80+ Mailgun: $80+ OpenShip: $0. Deploy it on your 5$ VPS. Unlimited domains. Unlimited inboxes. No per-email bill. No vendor lock-in. And yes - it works with one-click setup. No deep infrastructure work. Just add a few DNS records, and you're ready to go.
249
285
136
5,594
1,968,899
Crwla retweeted
Qwen3.8 is launching and going open-weight soon!🌐 With a massive 2.4T parameters, this model is continuously evolving. We believe it’s one of the most powerful model available today, compatible to leading frontier AI models , second only to Fable 5. You don't have to wait to test it. Just now, the Qwen3.8-Max-Preview made its debut on Alibaba’s Token Plan, Qoder, and QoderWork. Be among the very first to try it out. Can't wait to hear what you build. Stay tuned! 🚀  Token Plan international:qwencloud.com/pricing/token-… China:platform.qianwenai.com/prici…
1,305
3,249
2,058
24,003
8,437,448
Feeling all the love for Kimi K3 already. Here are some of the amazing things people have been building with it. Enjoy K3.
470
1,039
143
22,880
1,907,879
Crwla retweeted
It’s no exaggeration to say I come to X for exactly this kind of intellectual elitism. This is basically porn to me.
Some observations on Kimi: 1. It's a very good model! I don't think its performance can be explained away by distillation or anything like that. In agentic coding sessions, it seems pretty much on par with the best public models of Q1 2026. In my fairly limited use, it also seemed very token hungry. It's not obvious to me that this model is actually that cheap to run. 2. I am personally surprised the Chinese state continues to allow the open sourcing of models this good, given potential risks. To be clear, I *myself* might be fine with models presenting this level of marginal risk being open weight, but I am surprised that China is fine with it. I suspect the reason they are is 75% explained by strategic blindness/lack of AGI-pilledness (the CCP is very Yann Lecun-y in its views of AI). The other 25% or so is their lack of compute for customer inference (making China's open-weight strategy an unintended byproduct of US export controls) and the normal Chinese strategy of aggressive exports. For the companies, as opposed to the government, the decision to open source is partially ideological and partially because they are behind, and they know that very few people would pay for sub-frontier models from China. 3. Open-weight models are inherently decelerationist, and I'm continually surprised to see the so-called "accelerationists" so excited about open-weight models. I suspect the reason they are is that they know open-weight models are effectively ungovernable, and they simply like the overall cloak of ungovernability open-weight models create over the whole of AI. It's not a bad strategy; it reminds me of James Scott's recounting of the hill people in "the art of not being governed." Still, in the end, open-weight models deter further AI capex. 4. One probable outcome of an open-weight-model-dominant world is full AI communism, which is precisely what China proposes: rather than a market product, AI is a "public good" which will ultimately be provided by the state as a kind of "digital public infrastructure." This future strikes me as a dystopian hellscape, but I've never met an open-weight models advocate who doesn't ultimately concede this is where things end. You'd be surprised how many 'accelerationists' lobbied me, while I was in government, to support an eleven or twelve-figure federally funded data center so that startups could train models at a subsidy and then give them away for free. There was no other way for AI to progress, they said. Perhaps this is the logical end state of things. Nonetheless, I find myself surprised to see supposed accelerationists excited about such an outcome. I think many of them just don't know what they're doing. Many accelerationists do not view the creation and serving of frontier models as a legitimate business. 5. I would guess that the Trump Administration will at some point realize that their best strategy here would be to create large amounts of regulatory risk around the use of open-weight Chinese models. You don't need to "ban open source" (one of the dumber motifs of AI policy discussion). You just need to direct every agency to issue soft law that creates FUD. "A Federal Reserve Advisory Bulletin found that there may be backdoors in Chinese AI models." It needn't be that well justified. You just create enough regulatory risk that every regulated enterprise backs off. You probably don't want to create so much regulatory risk that you scare off the hyperscalers from serving Chinese models; this will just drive startups to sketchier providers. There's a happy middle ground here. I'd assume they will do some version of this. 6. It's probably true that open-weight models of this capability make the world a bit more dangerous, but not so much more that you'll really notice. At some point the models will be capable enough that you will notice. "A nonliving, invisible, dangerous, and infinitely self-replicating agent escaped from a Chinese lab," you say? Color me shocked.
60
114
5
2,708
690,382
Crwla retweeted
I've been using Kimi K3 for ~16 hours now. The model is clearly good at a lot of different things (especially frontend), but non obvious reason why people are enjoying it so much is that it clearly does not follow the same rules in terms of safeguards and copyright. Kimi will happily clone MacOSX. If you ask it to help you improve another AI model, it will do it with a smile on its virtual face. Ask Fable to do the same thing? It literally starts to perceive you as a criminal committing a war crime (like no bro, all I want to do is fine tune an open source model). After using all three recent releases, Fable, GPT 5.6, and now Kimi, it's clear that the full power of the models has been significantly held back by the safeguard restrictions caused by last months debacle with the USG -- leading to the top models being quite literally lobotomized in some areas, which leads to subpar results as the safeguards pollute its entire thinking and problem solving abilities. The funny part? Is that you could have predicted this outcome 2-3 years ago when you started to see the rise of Chinese EVs and smartphones compared to western alternatives. They quite literally tried to copy the Tesla Model S and iPhone as hard as possible and then eventually it started to diverge to the point where their EVs and phones are just genuinely better (which is why we have export controls banning their EVs, because they would literally drive all US manufacturers to ZERO) There is a very clear behavior difference in Chinese capitalism and American capitalism. American capitalism tries to protects copyright, patents, etc (oh no, you can't download a book through LibGen, that's ILLEGAL!). Versus Chinese capitalism actually just does not give a fuck. "Hey you want a video gen model (Seeddance 2.5) trained on every single anime ever? And you want the main character to look exactly like Messi? Sure, here you go!" You see what I mean? When one half of the competition is being held up by regulators and restrictions on people who don't understand the technology and the other half has a leader who quite literally today said they are going to set up AI centers around the world to help other countries onboard to their open-source AIs, this is the sort of results that you will start to get. These models were not smart enough to have this difference in philosophy matter -- but the newest class of models is where this difference makes a big deal. If these models are finally at the point where they are smarter than 99% of humans, why would you want to use the American one who tries to impose its world view onto you versus the Chinese one who will just do what you say without asking any questions? And this isn't a full on bullpost on Kimi, the model is clearly not as smart as Fable / GPT 5.6 on things like math and science, but it's lack of handcuffs means that it can show the world what the frontier labs are gatekeeping from you and that starts to build customer resentment and loyalty towards the East, which is probably not what the USG wants. Interesting times. Interesting times, indeed.
It finally finished, here's the final output. Used 60% of my monthly Kimi usage on it macos27.kimi.page
433
1,251
314
10,404
2,348,361