Sam Chen (@SChen1249) header
Sam Chen (@SChen1249) profile picture

Interested in how we can improve the world. CS @Harvard.

Massachusetts, USA
Joined November 2022
Photo by Sam Chen (@SChen1249)Photo by Sam Chen (@SChen1249)Photo by Sam Chen (@SChen1249)
Sam Chen retweeted
Holy Moly. METR got unprecedented access to Anthropic's internal AI R&D, including results from THREE unreleased models trained between July and October 2026. The newest, "Model 4," scored above 50% on all 15 benchmarks in Anthropic's capability index. METR estimates Anthropic made roughly TWO YEARS of benchmark progress in ONE, with AI driving ~80% of the acceleration. Anthropic staff self-reported an average 12x speedup using its most capable internal model.
Since August, a team within METR has worked with internal Anthropic information to assess whether AI itself is accelerating AI development. We are now publishing a report summarizing the results of this risk assessment.
13
39
2
704
65,736
The intelligence frontier keeps advancing every day. Are your agents delivering better outcomes on what matters? For enterprises, the promise of agents is more work completed reliably, with less human intervention and a lower cost per successful task. Today, we’re launching @neosigma_ai and our mission to empower every organization to build their own sovereign intelligence lab. A place to operationalize their knowledge, replay real work, and optimize agents against the outcomes that matter to their business. Where production experience compounds into intelligence the organization owns. We’re starting with NeoEval, our automated evaluation engine. It turns your production data into evaluation environments - that dynamically evolves along with your users, workflows, and frontier. A playground for evaluating and optimizing your agents. Your data. Your institutional knowledge. Now operationalized into evals and compounding intelligence. Stay tuned for the next few days of updates from NeoSigma.
95
56
54
276
297,049
I’m hiring investors to lead our gtm, partnerships and strategy! Feel free to dm me
16
7
162
11,997
We gave our AI system a spec, and in under 2 weeks, it designed, verified, and deployed a chip that beats NVIDIA. It’s built for low-power physical AI workloads. We’re running live inference on >B+ parameter models like Llama, Qwen, and Kimi, serving at 3.4x better perf/watt than NVIDIA Jetson. From just a specification, our AI system autonomously generated all of the RTL Design, UVM verification, formal proofs, firmware, drivers, and kernels, co-designing the model, software and silicon as one optimization loop. Better AI can now design better chips to run AI, leading to a loop of recursive-self improvement towards our path to abundant intelligence.
Readers added context they thought people might want to know
Architect Labs did not manufacture a physical chip; the design was tested on a commercial AMD Versal FPGA board. Furthermore, the 3.4x perf/watt gain over NVIDIA Jetson is a simulation-based projection for a future 8nm ASIC, not a physical benchmark. businessinsider.com/architect-labs… architectlabs.com/architect-labs…
103
237
175
2,008
678,115
Sam Chen retweeted
With the weights for the X algorithm being publicly released, use-signal.com is really gonna blast off deepwiki.com/xai-org/x-algor…
1
2
10
1,332
Stronger models alone don't make stronger agents. Evolving the harness is as important. Really interesting blog from @SChen1249!
2
6
447