
1st CS PhD student at @UofIllinois. Diffusion Language Models. Representation Learning.
Joined October 2025
- Tweets31
- Following39
- Followers117
- Likes19
Pinned Tweet
Continuous diffusion dominates image & video generation, but people used to believe that it inherently lags behind its discrete counterparts in language modeling.
Today, we challenge this belief with LangFlow: the first continuous diffusion language model that rivals—and even beats—discrete diffusion. (1/7)
Blog: caradryanl.github.io/blog/20…
GitHub: github.com/nealchen2003/Lang…
Arxiv: arxiv.org/abs/2604.11748
Solid!
Can an image generator learn its own hierarchy of abstractions without a separately trained encoder?
Meet HiT. Trained end to end from pixels, it learns to dynamically group patches across multiple levels—and semantic structure emerges without masks or region labels.
Check our video below: background collapses into a few groups, the main subject gets many, and words light up the regions they refer to!
It also gets 1.48 FID on ImageNet 256, uses 2.4× less training compute than JiT-H/16 at matched quality, and outperforms models with 6× more parameters on average across text-to-image benchmarks.
Website, paper, and code below, followed by how it works and what emerges 🧵
1
75
Glad to see!
Having been in the image generation community for this long, I've noticed some tricks that may boost your generation performance at no cost.
All the aggressive opinions below are my own, but credit for the findings goes to my amazing friends and collaborators @XiaoyuW9401147 @Weihang404 @lowerbad.🫡
56
Chumeng Liang retweeted
Having been in the image generation community for this long, I've noticed some tricks that may boost your generation performance at no cost.
All the aggressive opinions below are my own, but credit for the findings goes to my amazing friends and collaborators @XiaoyuW9401147 @Weihang404 @lowerbad.🫡
Chumeng Liang retweeted
Heading to SF for #COLM2026, Oct 7–10!
I work on forecasting with LLMs and RL for language agents — in particular, how models can predict the future and leverage such predictions for better RL algorithms for long-horizon decision-making.
I’m looking for internship and full-time research opportunities around:
• RL for language agents
• Forecasting and simulation with LLMs
If your team is working on these problems (or hiring!), I’d love to chat in SF.
I’ll also have two posters at COLM. We swapped our original poster slots, so please note the updated schedule:
📍 SocialVeil: Probing Social Intelligence of Language Agents under Communication Barriers
Oct 7, 11:00 AM–1:00 PM · Imperial Ballroom · Poster #62
arxiv.org/abs/2602.05115
📍 ArtifactLinker: Linking Scientific Artifacts for Automatic State-of-the-Art Discovery
Oct 8, 11:00 AM–1:00 PM · Grand Ballroom · Poster #140
arxiv.org/abs/2605.16902
Come by or DM me if you’d like to chat!
Great work stepping continuous DLMs forward.
💫 Large Language Continuous Diffusion Models
Presenting Sigma, the first large-scale (3B/8B) continuous diffusion LM (dLM) trained with likelihood.
📈 Comparable with discrete dLMs and AR on math and coding
🎛️ Enables meaningful study of inference-time interventions
Jointly led with Wei Guo (@WeiGuo01), Jean-Marie Lemercier (@jm_lemercier), Simon Welker (@_cobalamin)
Team: @YongganFu @mmkamani7 Sajad Norouzi @julberner @tomasgeffner @karsten_kreis @YongxinChen1 @MoleiTaoMath @jwthickstun @PavloMolchanov Ante Jukic @ArashVahdat @MardaniMorteza
2
129
Chumeng Liang retweeted
A language is only as useful as the community speak it!
"Beyond the code, we have a community goal. We want to build the language of statistics in Lean together with statisticians and lean experts: shared design decisions, open discussion of architecture"
Thrilled to share Statlib — building a community for formal research and education in mathematical statistics!
stat-lib.github.io/
Chumeng Liang retweeted
AI evaluation is entering an interactive benchmark era.
Across tool-use agents, web/OS benchmarks, multi-agent systems, and reliability evaluations, interaction is becoming central to how modern AI systems are tested.
But the field risks adding interaction faster than it develops the scientific principles for evaluating interaction.
Our position:
Interactive evaluation is not just longer tasks, tool use, or multi-turn interaction.
It requires a design science for mapping trajectories to valid evaluative claims.
📄 arxiv.org/abs/2605.17829
💻 github.com/keyangds/interact…
Chumeng Liang retweeted
👋Excited to share our new work:
Taming Outlier Tokens in Diffusion Transformers
We found that outlier tokens are not only a ViT recognition problem — they also appear in modern diffusion pipelines and hurt generation quality.
📜Project-page: a-little-hoof.github.io/dit-…
The potential of continuous DLMs extends far beyond just performance. They open the door for all continuous diffusion techniques to be introduced into language modeling:
- One-step generation, such as Consistency Models
- Guided generation, such as CFG
- Unified multimodal generation, such as protein structure-sequence co-design
LangFlow suggests: continuous diffusion is NOW a viable and promising paradigm for language modeling. (7/7)
Thanks to our great advisors Prof. Liu @GeLiuSaber and Prof. You @youjiaxuan! Also to our fantastic team @nealchen2003 @SuiHangke @RuihanGuo2 @ccr_cheng!
1
213
Chumeng Liang retweeted
🚨 RL for LLMs is finally accessible.
Introducing OpenTinker: The first community-driven, open-source framework designed to democratize Reinforcement Learning for LLMs.
github.com/open-tinker/OpenT…
Inspired by @thinkymachines's amazing Tinker, we realize the biggest bottleneck in agentic LLM research isn’t the math—it’s the setup. Current RL pipelines are messy. Configuring VeRL for every single experiment is a productivity killer.
OpenTinker fixed it.
🛠 How OpenTinker Works: Decoupled Design of Server and Client
- Setup Once, Run Forever: Configure the OpenTinker backend on your GPU cluster once.
- Develop Locally: Define your RL environments directly on your laptop.
- Train on the Cloud: Simply point your local client to the backend. The cluster handles the compute; you handle the science.
📉 The 10x Development Efficiency
Thanks to our elegant architectural decomposition, OpenTinker reduces the time to develop a new RL training pipeline by at least an order of magnitude.
⚡ Turn Idle GPU Compute into Gold
Small labs often have underutilized hardware. OpenTinker turns your idle GPUs into an internal/external API service for
- RL Training
- SFT
- Inference
🎯 Who needs OpenTinker?
- Researchers tired of infrastructure hell.
- Labs needing to standardize workflows.
- Teams wanting to maximize hardware ROI.
Thanks my amazing PhD student @realagi25 for leading the project. We are building the future of open RL infra. Be the first to build with us.
👇 Start Building with OpenTinker Now
🚀 Repo: github.com/open-tinker/OpenT…
🌐 Blog: open-tinker.github.io/openti…
If you believe RL should be accessible to everyone, give us a star, repost this 🔄 post, and let us know what agents you plan to build!
Goooood job
(1/n) Tiny-A2D: An Open Recipe to Turn Any AR LM into a Diffusion LM
Code (dLLM): github.com/ZHZisZZ/dllm
Checkpoints: huggingface.co/collections/d…
With dLLM, you can turn ANY autoregressive LM into a diffusion LM (parallel generation + infilling) with minimal compute. Using this recipe, we built a 🤗collection of the smallest diffusion LMs that work well in practice.
Key takeaways:
1. Finetuned on Qwen3-0.6B, we obtain the strongest small (~0.5/0.6B) diffusion LMs to date.
2. The base AR LM matters: Investing compute in improving the base AR model is potentially more efficient than scaling compute during adaptation.
3. Block diffusion (BD3LM) generally outperforms vanilla masked diffusion (MDLM), especially on math-reasoning and coding tasks.
210
Chumeng Liang retweeted
Multi-Agent Evolve is now fully open-source 🚀
With our codebase, you can pick your favorite LLM checkpoint and let it self-evolve, WITHOUT external supervision
💻Code:
github.com/ulab-uiuc/Multi-a…
🤗Model Checkpoints:
huggingface.co/collections/u…
Feedback and contributions are welcome!
Introducing Multi-Agent Evolve 🧠
A new paradigm beyond RLHF and RLVR:
More compute → closer to AGI
No need for expensive data or handcrafted rewards
We show that an LLM can self-evolve — improving itself through co-evolution among roles (Proposer, Solver, Judge) via RL — all without external supervision.
On Qwen2.5-3B-Instruct, Multi-Agent Evolve boosts average accuracy from 55% → 58% across 22 benchmarks.
Remarkably, the model automatically learns balance among roles:
- The Proposer first generates easy tasks.
- The Judge refines the difficulty metric.
- The Proposer then raises the challenge, forcing the Solver to improve.
- The system co-evolves until reaching equilibrium.
Multi-Agent Evolve: LLMs self-improve through co-evolution.
📄 Paper: arxiv.org/abs/2510.23595
💻 Code (coming soon): github.com/ulab-uiuc/Multi-a…
Chumeng Liang retweeted
We believe future forecasting is the ultimate challenge for agentic LLMs.
🚀 Live Trade Bench is now fully open-sourced!
It’s the first live, real-world benchmark testing 20+ LLMs on financial forecasting.
📄 Read our 37-page paper detailing insights from a 2-month live trading experiment:
👉 arxiv.org/abs/2511.03628
📊 Track real-time performance across 20 LLMs here:
👉 trade-bench.live
💻 Developers interested in LLM benchmarking or trading? Try it out with:
pip install live-trade-bench
🔗 Code: github.com/ulab-uiuc/live-tr…





















