Sangwon Jang (@jangsangwon7) profile picture

PhD student, @kaist_ai | prev intern @nvidia

KAIST
Joined April 2022
Photo by Sangwon Jang (@jangsangwon7)Photo by Sangwon Jang (@jangsangwon7)Photo by Sangwon Jang (@jangsangwon7)Photo by Sangwon Jang (@jangsangwon7)Photo by Sangwon Jang (@jangsangwon7)Photo by Sangwon Jang (@jangsangwon7)Photo by Sangwon Jang (@jangsangwon7)Photo by Sangwon Jang (@jangsangwon7)Photo by Sangwon Jang (@jangsangwon7)Photo by Sangwon Jang (@jangsangwon7)
What if your video generator could refine itself—at inference time? ❌No new models. ❌No retraining. ❌No external verifier. 💡 Introducing Self-Refining Video Sampling By reinterpreting a pretrained generator (Wan2.2, Cosmos) as a denoising autoencoder, we enable iterative self-refinement at inference time ➡️dramatically improving physical realism and achieving over 70% human preference! 🧵
3
25
8
180
42,718
Sangwon Jang retweeted
🔬 Can AI discover unknown scientific knowledge by itself? Excited to introduce Principia: Test-Time Hypotheses-to-Principle Construction for Scientific Discovery. Principia uses LLMs to turn experimental observations into scientific principles at test time: 🔍 From observations to hypotheses Compare related inputs and their outcomes to propose explanations for how specific characteristics contribute to the observed results. 🧠 From hypotheses to principles Generalize recurring relationships across hypotheses into broader principles that guide subsequent predictions and candidate generation. 🔄 Refine knowledge with new observations Use new observations to revisit earlier hypotheses and reconstruct the principles built on them. Huge thanks to my co-authors at @KAIST_AI: @SangwooPark0306, @jinheonbaek, @SoyeongJeong97, and @SungJuHwang1 📄 Paper: arxiv.org/abs/2610.32195 #AIforScience #ScientificDiscovery #LLM #TestTimeLearning #KnowledgeConstruction
15
2
34
2,524
Sangwon Jang retweeted
Unitree Introducing: H2-X Kung Fu Legend Guardian🤖 Powerful performance to serve and guard you, with a maximum endurance of approximately 8 hours. Please use the robot safely and in a friendly manner.
1,926
3,805
3,042
28,561
16,589,647
Sangwon Jang retweeted
🎉 Excited to share AutoSciBench, a project I worked on during my internship at #Genentech! Can AI agents create scientific tasks they can’t solve? 🔬 As agents advance, existing benchmarks can become too easy to distinguish their capabilities. Yet constructing and updating scientific benchmarks still requires substantial time, labor, and domain expertise. 🛠️ AutoSciBench turns agents into benchmark builders. They construct questions, scientific data, and ground-truth answers, then put solver agents to the test. Feedback from these attempts guides task refinement and the generation of new, more challenging tasks. 💡 Takeaway: Benchmarks can evolve alongside the agents they evaluate. 📄 Paper: arxiv.org/abs/2610.05140 Huge thanks to @namkye0n9, @suragnair, @CarlEdwards_NLP, @hyanan16, @EdwardOnBrew, @JennaLCollier, @SungJuHwang1, and @EhsanHRA for their collaboration, thoughtful discussions, and support throughout this project!
9
2
27
1,470
Sangwon Jang retweeted
Your emails, chats, docs, and tickets keep piling up, and the right ones get harder to find. 😡 🗺️ Introducing CorpusMap, which organizes a growing corpus around recurring entities, so agents follow connections instead of searching from scratch. 📈 Better answers, fewer tokens.
1
17
1
48
3,531
Sangwon Jang retweeted
🎉 Excited to share that ES-Merging has been accepted to NeurIPS 2026! 🎉 💡 Biology connects molecules, proteins, and cells. How can we bring their AI experts together? We use embedding-space signals to merge specialized biological MLLMs into one model: 🧩 Combine expertise at both layer and parameter levels 🔗 Improve cross-modal reasoning 🧠 Better preserve single-modal knowledge Huge thanks to my co-authors @WonbinLee067 and @SungJuHwang1 for their collaboration and support! Check out the paper and code for more details and results😊 📄 Paper: arxiv.org/abs/2603.14405 💻 Code: github.com/WonbinLee067/es-m… @KAIST_AI @MLAI_KAIST
7
27
907
reproduced the experiment in MuJoCo: asked gpt6 astra to paint Eiffel Tower in simulation using so101 and a paint brush, see the entire experiment huggingface.co/buckets/mishi…
i gave astra a robot, a paint brush, and a camera then asked it to paint the golden gate bridge in real life! it figured out how to control the robot, and progressively got better throughout its attempts. the timelapse is sick
4
29
7
291
37,553
Sangwon Jang retweeted
What is the role of academic computer vision research in the age of increasingly powerful large models? Is GPT-6 Astra a step change? How can a researcher have an impact today in academia? These are the questions I ask myself as I head off to ECCV 2026, a conference I’ve attended since 1992. One of my papers this year is VIGA, a method that takes an image as input and outputs a 3D Blender scene that represents that image. This is a classical inverse-graphics task and VIGA was the first method to solve it using an agentic approach. The idea is now several years old and the first version of the paper was rejected. This delayed publication significantly. After it was accepted at ECCV, it was quickly surpassed by people using Claude Code for the same purpose. Today GPT-6 Astra blows away all previous results. But we still head off to ECCV to tell the community about our invention that is now fully out of date. The way academic work often progresses is that one reads recent papers, notices that they have limitations, comes up with a new idea, explores this, publishes it, etc. Any published paper I read today is based on ideas that are at least a year old. And those ideas were based on the literature of the time, which was also a year old. That means that any paper I see at ECCV is likely two years out of date. In AI today, two years means your work is likely irrelevant. At CVPR this summer I noticed that many authors have not gotten the message. They continue to work on “old” problems that have a long history. This history is based on assumptions about how the “vision problem” will be “solved”. The truth is that it is being solved in a very different way and many of these problems are no longer relevant. Another group of papers focuses on very niche problems where large models likely fail because of insufficient data or lack of business interest. The impactful papers were largely from industry and had long author lists and massive data+compute behind them. These papers were also out of data, describing systems that had been released months before, but at least they served to provide the community with more complete documentation and analysis of commercial systems. So what should academics do? First, we need to put aside the tools we’ve used for years and start from scratch. Every project should start by trying really hard to solve the problem with existing tools. I would like to see every paper begin with a detailed experimental analysis of how existing models perform and why they fail (if they do). This gives the kind of insight we need today. Then, assuming current models fail, the solution should provide some fundamental insight that will outlive the next release of such models. Reviewers today still focus on technical novelty. This pushes people to focus on tweaking architectures rather than clearly moving the field forward. Papers need to be judged based on their novel insight and not their novel technical contribution. This is a real shift in thinking but it focuses us on what matters - progress of the field. If we want there to be a “field” of computer vision, then it can’t become a marginal backwater, focusing on esoteric problems. If you haven’t tried using Astra (or whatever comes next) to solve your problem, then you have not done your homework. This omission should be seen as negatively as not having a previous work section. Concretely, I think papers should include a new section analogous to “Related Work” where that related work is current models and how they perform on the task. Reviewers should start asking for this and expecting authors to be able to articulate their insights about the limitations of existing large models. I'm interested in your thoughts.
91
394
68
2,392
689,950
Sangwon Jang retweeted
GPT-6 Astra scored 95% on a robot control task, up from Fable 5.1's 40%, with 6.2x fewer output tokens at 2.3x lower cost. 🧵
165
633
336
5,745
1,977,569
Sangwon Jang retweeted
Atlas is an autoregressive diffusion model built from the ground up for the task of "next frame prediction". It is simultaneously a world class method for camera-controlled video generation, novel view synthesis, and sparse 3D reconstruction.
Introducing Atlas: The world's first multimodal world model that generates image and video frames with pixel-perfect camera control and reconstructs them in 3D. Model the world, move the camera, and simulate space & time.
28
40
3
545
61,504
Sangwon Jang retweeted
Excitement about world-action models and robot learning has never been higher — they promise a way to use human egocentric data to train massive robotics models which can provide the “GPT” moment for robotics and unlock general-purpose embodied intelligence. And yet there’s been little concrete demonstration of scaling in robot learning. @DynaRobotics aims to change that, with an in-depth look at how scaling works as they approach 1 million hours of training data. @JasonMa2020 @tianyurobot @_anhquanpham and @ChetBhateja joined us to tell us more. They show that as the amount of data they use in pretraining increased, they saw predictable, statistically significant gains on accuracy metrics on held-out data (data not seen during training). They go on to talk about what they learned, and show how this can be applied to many different problems. Watch Episode #99 of RoboPapers, with @micoolcho @chris_j_paxton @DJiafei today to learn more!
1
10
5
75
26,268
Sangwon Jang retweeted
Introducing Waddle Labs: Claude Code for robots. Connect our API to your robot and enter a prompt, then our agents write code to achieve the task in 20 minutes. @yiding_song @theWaddleLabs
204
229
136
2,463
711,428
Sangwon Jang retweeted
🎼 Can we turn music into readable code? Excited to share Decomposer, a post-training framework for symbolic music decompilation! Given MIDI, Decomposer recovers an executable program in Strudel that reconstructs the music while exposing patterns, harmony, rhythm, and voices as editable code. 🧵 [1/5]
11
48
8
277
45,505
I'll be presenting Self-Refining Video Sampling with @Jaehyeong_Jo at #ICML2026. Come chat with us about physically plausible video generation! 🗓 Tue, Jul 7 | 2:00 PM–3:45 PM 📍 HALL A #2512 Paper: arxiv.org/abs/2601.18577 Page: agwmon.github.io/self-refine…
What if your video generator could refine itself—at inference time? ❌No new models. ❌No retraining. ❌No external verifier. 💡 Introducing Self-Refining Video Sampling By reinterpreting a pretrained generator (Wan2.2, Cosmos) as a denoising autoencoder, we enable iterative self-refinement at inference time ➡️dramatically improving physical realism and achieving over 70% human preference! 🧵
1
6
19
1,554
Sangwon Jang retweeted
Can we make head avatars more interactive? Check out our work, Avatar Forcing, at #CVPR2026. 🗓 Sat, Jun 6 | 11:45 AM–1:45 PM 📍 ExHall F #357 Paper: lnkd.in/ghgt2zhv Page: lnkd.in/g95uH-as Code: lnkd.in/gdkw9MZv
2
5
549
Sangwon Jang retweeted
Can MLLMs actually track what's happening in a video? Introducing VSTAT 🎯, our new benchmark for visual state tracking. The tasks are simple: count cups, read typed words, count page flips. Humans solve them easily. MLLMs don't. vision-x-nyu.github.io/vstat… 🧵 [1/11]
11
65
7
244
170,421
Sangwon Jang retweeted
What if your retriever could speak every language your data speaks? 🌐 Your answer might live in a document 📄, a SQL table 🗃️, an RDF knowledge graph 🔗, or a property graph 🕸️, and OmniRetrieval reaches into all of them, meeting each source in its own native query language instead of flattening everything into one lossy space. Paper: huggingface.co/papers/2605.2…
1
30
4
75
6,213
Sangwon Jang retweeted
Excited to introduce 🧑‍🎓𝗟𝗲𝗮𝗿𝗻 𝗳𝗿𝗼𝗺 𝗪𝗲𝗮𝗸𝗻𝗲𝘀𝘀𝗲𝘀 (LearnWeak)! A framework that automatically specializes small CUAs for specific domains by 🎯𝘁𝗮𝗿𝗴𝗲𝘁𝗶𝗻𝗴 𝘁𝗵𝗲𝗶𝗿 𝗼𝘄𝗻 𝗳𝗮𝗶𝗹𝘂𝗿𝗲 𝗽𝗮𝘁𝘁𝗲𝗿𝗻𝘀 in data generation and training. 🧵(1/7)
6
12
1
20
1,162
Sangwon Jang retweeted
🚀 Releasing ✨AXPO✨ an RL method to lift agentic reasoning models past their next scaling tier. Be it math, perception, or search, AXPO fixes the structural blind spot 'just add tools' recipes leave untouched. 8B beats 4x larger 32B baseline on Pass@4. from NVIDIA 🧵 (1/7)
4
40
2
192
16,299
📢 New preprint out on contextual integrity (CI) and a new Product-of-Experts (PoE) view of self-distillation! Introducing SelfCI, a novel self-distillation framework that operationalizes CI by optimizing for the intersection of task utility and minimal disclosure. 🧵👇
1
11
3
33
6,098
Sangwon Jang retweeted
Can LLM agents build memory before seeing any user task? Memory is usually built from human tasks or deployment interactions. New tool environments often have neither, creating cold-start gap. Introducing PREPING: building agent memory without tasks. dozi01.github.io/preping-pro…
5
10
2
22
2,817