
Training/RL Infra @periodiclabs | Prev @amazon agi sf lab, @ByteDanceSeed_ | CS Alum @gatech_scs, @sjtu1896
San Francisco, CA
Joined March 2021
- Tweets13
- Following329
- Followers46
- Likes98
I’ve felt increasingly overwhelmed by the rapid progress of frontier models this year. I can’t help but wonder: what’s left for humans to do?
Building a benchmark feels like a great way to really understand how AI might automate my own day-to-day work.
So we built one!
Introducing Singularity-Bench 🕳️
🔄 We measure whether agents can autonomously conduct the full agent development lifecycle: six long-horizon, end-to-end tasks spanning pre-, mid-, and post-training, inference engines, cluster management, and harness development on production GB300 clusters!
We emphasize rigorous verification to guarantee correctness and execution integrity 👮♂️
🙌 Big shoutout to all authors contributing from academia and industry: @IronSteveZhou, @wonderingkrish, @chenzhuoming911, Zerui Wang, @KyriectionZhang, Wenshuang Li, Xinpeng Wei, Zhichen Zeng, @Jingyu227, @JueWANG26088228, @Wu_Sen, Ziheng Jiang, @zhendongucb, @hancai_hm, @Hades317, @ying11231, @ce_zhang, @uiuc_aisecure, and @BeidiChen!
How far are current agents from building their successors end to end? 🤔 We're here to find out!
🧵1/n
🌐 Website: infini-ai-lab.github.io/sing…
WindowsXp retweeted
Yesterday was my 23rd birthday.
As a present, I got laid off from Amazon AGI!
I’m actively looking for new opportunities, particularly related to computer use agents and post-training.
Since October 2024, I've been working on GUI agents non-stop: computer use at @SimularAI, mobile use @Apple, and browser use @AmazonScience.
With recent benchmarks like OSWorld 2.0, ALE, etc., it's clear CUA is far from solved, and would love to continue pushing.
Please reach out if you have any openings!
We trained a ~frontier Deep Research Agent on academic budget
> 32 H100s
> 8K synthetic samples
> fully open training infra + recipe (SFT, mid-training, RL)
> models of diff sizes (2B -> 35B) ready to use out of the box
This is yet another demonstration of how the frontier of AI is changing. We have reached a point where open models + a small capable team + a few hundred Ks can produce specialized models with ~frontier capabilities. The future of AI doesn’t have to be held in a chokehold by a handful of closed models.
We've open-sourced everything we've built and learned from this project. Hope it helps the community build more!
📌 Project: osu-nlp-group.github.io/QUES…
📌 Paper: arxiv.org/abs/2605.24218
📌 Code: github.com/OSU-NLP-Group/QUE…
📌 Model Weights and Data: huggingface.co/collections/o…
📌 Demo: huggingface.co/spaces/osunlp…
Amazing effort led by @jianxie_ (our 1st year student!!), Tianhe Lin, Zilu Wang. joint with @hhsun1 and the @osunlp team. thanks @amazon Xiangjun Wang for a gift that covers the compute and fruitful discussion.
WindowsXp retweeted
At Amazon's AGI Lab, XJ Wang's Reinforcement Learning Pod team trains AI agents using RL gyms for real-world applications. His team handles everything from model training to product integration across Amazon. Learn more:
谁借我台Apple Silicon的Mac玩一玩🥺
Just in time for the holidays, we are releasing some new software today from Apple machine learning research.
MLX is an efficient machine learning framework specifically designed for Apple silicon (i.e. your laptop!)
Code: github.com/ml-explore/mlx
Docs: ml-explore.github.io/mlx/bui…
213
WindowsXp retweeted
1/5 One for animal behaviourists. About 10 years ago I placed a Barn owl nest box in this barn and almost immediately a pair of jackdaws moved in and made it their home raising numerous broods over the years until 2022. In 2022 a pair of Barn Owls evicted the jackdaws and











