
低强度工作,高强度刷推,摸鱼主理人,不键政,不喜欢粉红 #老婆@whikylucky
People's Republic of China
Joined November 2017
- Tweets1.5K
- Following818
- Followers902
- Likes827
喜欢这一篇。
坚持思考,去理解事物背后的东西从来艰难,在现在这个 Agent 让大脑过载的时代,更是如此。但假如因此放弃思考,不再深入理解问题和细节,一切只求速度,就一定对吗?
layered.meow.plus/post/agent…
0xNullPath retweeted
Introducing Qwen3.8-27B-pi-adapted 🤗
We adapted Qwen's model specifically for the pi coding agent using reinforcement learning and a LoRA adapter.
The results, measured as pass@1:
🚀 SWE-bench Pro (Hard 51): 29.4% → 62.7%
💻 Terminal-Bench 2.1: 39.5% → 55.8%
⚡ 55–62% fewer tool calls per task
This is the power of open models: you can adapt them to YOUR tools and YOUR use cases. Let’s build! 💛
Open weights: huggingface.co/harness-hub/Q…
Methodology: huggingface.co/blog/harness-…
The Return of the GPUs King
Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me.
I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA.
I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation.
Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO.
Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours.
Jensen
1
104
0xNullPath retweeted
Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me.
I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA.
I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation.
Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO.
Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours.
Jensen
0xNullPath retweeted
Two weeks ago we announced Together Compiler: agents that tune inference to your model, chip, and traffic, for up to 2.6x more throughput.
Today, we’re sharing the journey behind it: the experiments that challenged our assumptions of megakernels, the surprising strengths of Torch Compile, and the lessons that shaped our development of a next-generation system for inference optimization.
Shout out to @dylan__lim @reyna_abhyankar @simran_s_arora and the team!
Read more: together.ai/blog/road-to-tog…
0xNullPath retweeted
记不清 day 几了,上线一个新的可观测性 feat, api.kern-llm.org/status/,你可以实时看到 kernel 耗时(类似 tracing 中的体验),并且可以看到同一时刻的硬件利用率(来自 CUPTI),目前打开了 sm, tensor core, dram ,后续可能打开 nvlink(目前这个机器没有),我们依旧也会 dump 出 parquet(option)。
可观测的段落到这里可能就结束了,kern 能实时低开销做到这样的可观测性(以及用户体验性),真得说个 SOTA 了吧。不过这个看板上可能还会多一个东西(应该也在本周),算是某种“可观测”的吧。
等一切准备好后,我们会开展一个更大的实验(敬请期待)。
性能,正确性,更多的 harness,我也正在思考沉淀。
Base URL: api.kern-llm.org/v1
API Key: sk-kern-5vi93pdFZrDi7ofBlo-7l5DaH5BPJ3VjUeKNa_XGeqU
Model: Qwen/Qwen3.8-27B-FP8
GPU: 我的 rtx pro5000
我们启用了 @TencentHunyuan 的 DSpine,并发低的时候,tps 100+,高并发也有40tps 左右。kv cache 目前由 gpu 顶,我有空把 SSD kv cache 开了(1TB),免费用,只是用来看看 kern serve 会有啥问题没有。
my AIE talk is up! come hear how the grok @bot team ships so quickly without compromise on quality
youtu.be/O_zcc6Xl12g
0xNullPath retweeted
推特上许多讨论黄仁勋的,都集中在商业判断、Dennys创业纪念碑的去留、情愿和私生活八卦上
但我发现最打动人的,还是在老黄落难之际,许多之前受过他滴水之恩的人出来主动post testimonial
一件件具体而分布散落的事件指向一个真相 —— 老黄确实是乐善好施乐于助人之人
而且我也相信,为人抱薪者,不可使其冻毙于风雪
图1 - 11 年前,一个印度普通大学的学生 @recurseparadox 给黄仁勋发cold email,问能不能要几块 GPU。15 分钟后,收到了回信。
图2 - Serve Robotics 的创始人 Ali Kashani @ahkashani ,记得的是一个早上 6 点的电话。2023 年圣诞节前,投资人临时撤资,公司连工资都快发不出来。他已经在和破产律师谈了,于是给黄仁勋写了封邮件。
早上 6 点,黄仁勋打来电话。当天晚上,他已经在和英伟达团队吃饭,商量怎么帮公司渡过难关。四个月后,他们敲响了纳斯达克的钟。
图3 - 同样是回邮件,Simon Mo @simon_mo_ 讲过另一件事:团队的算力被收回,vLLM 在 Blackwell 上的开发受阻。他写信给黄仁勋,同一分钟就收到回复,问题连夜解决。
图4 - 英伟达员工 John Zedlewski @zstats 的长帖,讲了两件不同领域但同样伟大的事。
一件是他重病住院,处在最低谷时告诉了黄仁勋。黄仁勋立刻联系斯坦福的人,帮他协调进入临床试验。
另一件发生在工作中。自动驾驶部门开会,A 团队抱怨 B 团队的框架太慢。黄仁勋让 B 团队把整个数据流画到白板上,标出每一次内存拷贝。多余的拷贝就这样露了出来。
第二件我特别有感触,不同于大部分公司里面,遇到类似的问题,往往因为领导层自己也不懂技术,所以只能模糊的给一个,“我们研究一下,下周答复你”的模糊回答(然后不了了之)。
实事求是,原地分析,当场解决问题。太有魅力了
图5 - Vartika Singh @vartuattheghat 的妹妹患脑癌,在加州时病情恶化。全家陷入了难以想象的困境:令人心碎的医疗抉择、高得令人难以承受的住院费用,以及可能在远离家乡的地方失去她。
尽管肩上担子沉重,黄仁勋还是抽出时间关心他们。帮助她的家人渡过了看似无解的难关。黄仁勋还当面鼓励她:“我为你感到骄傲。珍惜你们在一起的时光。”
这,我的朋友,才是真正的领导力 leadership。
图6 - 在英伟达工作 11 年的 Gabriele Leone @ambertanuki ,记住了疫情期间的一个决定:办公室空了,厨房和清洁人员几乎没活可做,黄仁勋仍决定把他们全部留下。
当所有500强企业都在裁员,跟风裁员是最容易的选项的时候。黄仁勋考虑的不是公司的股票业绩和财务报表。他看到的是公司里最容易被忽略的人,也替他们想了一下。
图7 - 大约 30 年前,一个学生志愿者 @Fuzzygoat 在洛杉矶 SIGGRAPH 的酒店电梯里遇到黄仁勋。两人下楼,发现去会场的班车已经走了。
黄仁勋叫了辆出租车,坚持让这个学生一起坐。
没有投资,没有 GPU,也没有什么大事。这个学生却一直记到了现在。
为人抱薪者,不可使其冻毙于风雪
为人抱薪者,不可使其冻毙于风雪
为人抱薪者,不可使其冻毙于风雪
伟大,无需多言
现在市面上充斥着太多虚假的PR,一个个公司花尽心思掏钱把创始人打扮的善良博爱
真正的博爱,不是花钱买公关。而是年复一年,日复一日的践行自己做人的准则。
写一篇不是为了批判谁,而是自己在刷推的时候强烈的感受到四个字:见贤思齐
0xNullPath retweeted
I have a particularly nasty case of cancer. When I was hospitalized again at my lowest point last year, I told Jensen. He immediately reached out to contacts at Stanford, who were able to cut through red tape, and get me into a clinical trial for which I've turned out to be a perfect fit. I think everyone can have their own views about recent events. But any claims that Jensen did not really care about his staff is simply inaccurate. I, personally, owe him more than I can express.
I think the best tribute we can pay to Jensen's legacy is to drive NVIDIA's continued success and push the whole industry forward, by showing we've learned the lessons from years of working here. We will compare ourselves against Speed of Light. The mission will be the boss. And we will not be scared to take smart, bold risks and fail fast with ruthless intellectual honesty.
But if there is one management story I remember the most, it's a particular Jensen grilling from my time in autonomous vehicles that stayed with me. Luckily I was not in the hot seat for this one. Team A didn't want to use Team B's framework, because they thought it was too slow. Jensen was surprised - it's just applying a bunch of optimized CUDA kernels in sequence, how could it be slow?
So he asked the executive from team B to draw the entire data flow sequence from their framework on the whiteboard and highlight every memcpy. Sure enough, there were a bunch of unnecessary memcpy's surrounding each pipeline stage. Everyone in the room could see why it wasn't getting to SoL and a path to improve things. No arguing about fiefdoms or appeals to authority - the data got us all on the same page.
The lesson was not (just) that unnecessary memory copying is bad. It's that executives should not be afraid to probe into details if something doesn't add up, and leaders need to be technical enough and honest enough to engage in real time and not turn every meeting into "I'll get back to you in a week." If that means counting memcpy's with a billionaire CEO, so be it.
My best executive meetings at NVIDIA have been when I'm fully prepared to present every detail of my team's work, and my worst failures have come when I realized I couldn't go deep enough to really solve the problem.
But the thing that gives me confidence is that Jensen was never the only one to live this philosophy. Anyone who has presented to an SVP at NVIDIA knows they are at risk for getting grilled on fundamental constraints and technical details. I have been part of amazing conversations with both recent and old timer leaders where we were able to get to the core of a problem in an hour rather than a month, because we had the right people in the room and were not afraid to go deeper.
The company is filled with supremely talented people who have been trained for 3 decades to work at the highest level, and you can see it in what we produce every day. I'm so proud to be an NVIDIAn, and I can't wait to show off what we ship in the coming months and years.
0xNullPath retweeted
虽然加入 NVIDIA 的时间不长,但是是我经历过最好的公司,遇到的最好的团队。
团队的每一个朋友都很好,老黄真的会看每一封他能看到的邮件,哪怕你是 Nobody.
还会经常回复,每个同事也都是从心里的热爱这个事业跟着 Jensen 的战略走。
0xNullPath retweeted
BREAKING: hundreds of NVIDIA employees have signed an internal letter demanding the reinstatement of Jensen Huang as CEO and the resignation of the board
Readers added context they thought people might want to know
Many NVIDIA employees commented in support of bringing back Jensen Huang on an internal suggestion box post, with over 1,600 replies. No reports confirm a signed letter like the one shown. Jensen Huang has resigned as CEO; Colette Kress is interim CEO.
wired.com/story/nvidia-e…
nvidianews.nvidia.com/news/nvidia-an…
这动图画的太好了... TIM下trainer一直追一次有一次叠加TIM误差的Sampler...最后被Sampler带沟里。。。
SC就直接把TIM的那个误差\mu 统计出来直接减掉(
Why is RL so sensitive to training-inference mismatch (TIM)?
With each training step, the trainer is pulled toward the sampler, resulting in accumulating drift.
We exploit this intuition to devise a novel correction method to stabilize RL under TIM, called Score Centering.
1
3
147
钱准备好了 @leon7hao ,版本呢?
3
302
0xNullPath retweeted
Want to know what happened in a @bubdotbuild tape? Use a Walkman, of course.
$ uvx bub-walkman [TAPE_FILE]
github.com/bubbuild/bub-walk…
🥳
Exciting thing here (really exciting!). Introducing our new Nsight Perf SDK for AI, a beta preview, that enables a very, very low overhead collection technology at profiling data rates aka 10Khz+ with the ability to attach to running workloads, see your CUDA kernel traces and tie those to hardware metrics...
Check it out, give feedback and yes we are building other fun stuff on top of this... stay tuned!
github.com/NVIDIA/nsight-per…
122
0xNullPath retweeted
同事去帕劳自由潜了,老板也出门了,发不了版了
于是我们只能先把 repo 开了😜 🥳
Dim 终于开源啦! 正式扬帆起航~
github.com/arcships/dim
非常感谢 @aiandcloud @HEHEHEHEHE2333 赞助的超高速 deepseek 驱动!🥰🥰🥰
诶嘿嘿,鸡汤来咯。其实对于 @bubdotbuild 0.6.0 这个版本,最重要的是我们得到了一些生产环境的反馈,所以 @frostming90 在强化 bub core SDK 上下了很大功夫,现在你可以自如地将这么一个 event driven 的 Agent loop 任意嵌入到你的 Python 应用之中。
当然 bub 0.6.0 也切换到了我们自己维护的 republic 来做 ai providers 的支持,没有别的 pypi 包拖家带口的陋习,还对 magpie 提供了一流支持,所以其实你在 bub 里可以轻松使用由 magpie 管理的路由组,此处应该艾特叶天帝 @yetone
bub 的一些经典设计比如 Tape 和近期引入的重要特性像 CodeMode 都得到了保留和增强,计算、状态和环境依然如此前的版本一样可以分开部署和管理。日常体验也做了一些改善,比如模型补全、插件版本,以及 OSC 7501 支持。
特别感谢 @1ooogle 匠心手做的文档和精心设计的 Todo Agent 示例,很离谱啊,给文档写的 demo 项目整那么好看
代码是开源的,欢迎关注:github.com/bubbuild/bub
Bub 0.6.0 separates bub.core from the full app. Both use the same agent loop. pip install bub now gets the kernel. To upgrade the CLI, channels or plugins from 0.5.1, use pip install -U 'bub[app]'.
🧵(1/5)
github.com/bubbuild/bub/rele…




































