Yihang Luo (@onelineluo) profile picture

Ph.D Student, 3D/4D Spatial AI @MMLabNTU | Ex Undergrad, SuperComputing Team @NTUsg

Joined August 2022
Photo by Yihang Luo (@onelineluo)Photo by Yihang Luo (@onelineluo)Photo by Yihang Luo (@onelineluo)Photo by Yihang Luo (@onelineluo)Photo by Yihang Luo (@onelineluo)Photo by Yihang Luo (@onelineluo)Photo by Yihang Luo (@onelineluo)Photo by Yihang Luo (@onelineluo)Photo by Yihang Luo (@onelineluo)Photo by Yihang Luo (@onelineluo)
Yihang Luo retweeted
What if you could step inside a painting? We use Mundo to imagine new viewpoints from a single image of Raphael’s fresco, The School of Athens.
1
1
4
341
Yihang Luo retweeted
🎥Reshoot a video from a camera that was never there~ Excited to share #Holo4D, accepted to #neurips2026 ! Give it a video and a new camera path: Holo4D lifts the video into 3D tracks and uses them to steer a video model. The camera moves; what happened stays the same. 🧵
5
17
2
87
6,992
What if you could step inside a van Gogh painting? We used Mundo to imagine new viewpoints from a single painting. Take a look at this short demo. Project: mundo-world-model.github.io/ Blog: huggingface.co/blog/Luo-Yiha…
4
24
2
181
10,817
👋 What if you could turn your own environment into a programmable world—one you can explore, edit, and interact with? 🌍 Excited to introduce Mundo, our customized world model that brings this vision to life! Amazing work led by @onelineluo! Given a few context views, a VLM agent builds and programs a 3D proxy world; code controls its state, physics simulates its dynamics, and a video generation model renders the results. Mundo enables spatiotemporal exploration, precise interactions, and physically grounded simulations—all driven by code. More broadly, agentic generation could be the next major paradigm for world models and controllable video generation, unlocking parameterized control and physically grounded interactions. 🚀
🌍 Introducing Mundo, led by my student @onelineluo: a customized world model that turns images of a place into an environment for exploration, editing, and simulation. Explore new viewpoints, change objects and physical properties, or simulate robot navigation and manipulation — all within the captured environment. The key is an explicit, editable world state: code specifies actions, physics computes their consequences, and a video model renders the outcome using the input images as visual context. Project: mundo-world-model.github.io/ Blog: huggingface.co/blog/Luo-Yiha… Code coming soon!
1
1
4
517
Yihang Luo retweeted
We’ve built a customizable world model that turns just a few photos into an interactive virtual environment. Let's transform real-world scenes directly into virtual spaces ready for exploration and manipulation! Project: mundo-world-model.github.io Blog: huggingface.co/blog/Luo-Yiha…
6
37
3
239
10,915
🌍 Introducing Mundo, led by my student @onelineluo: a customized world model that turns images of a place into an environment for exploration, editing, and simulation. Explore new viewpoints, change objects and physical properties, or simulate robot navigation and manipulation — all within the captured environment. The key is an explicit, editable world state: code specifies actions, physics computes their consequences, and a video model renders the outcome using the input images as visual context. Project: mundo-world-model.github.io/ Blog: huggingface.co/blog/Luo-Yiha… Code coming soon!
4
21
7
129
10,926
This is why I refuse to work on camera estimation problems. For embodied AI, I consider it a **solved** problem at large – there are better things to spend your time on. It's only a "problem" in academia.
AIメガネのMeta Ray-BanでVPS(カメラで場所を正確に把握する技術)が可能に。 高精度な音声ナビや配車位置特定、複数人での位置共有が可能に。 VPSによる正確な位置の認識により、必要な時と場所で適切なデジタル情報を正確に表示する、新しい空間体験が可能になります。
11
16
4
238
74,861
Yihang Luo retweeted
Introducing 𝗦𝗧𝗿𝗲𝗮𝗺𝟯𝗥, a new 3D geometric foundation model for efficient 3D reconstruction from streaming input. Similar to LLMs, STream3R uses casual attention during training and KVCache at inference. No need to worry about post-alignment or reconstructing from scratch. You can easily add new frames and update the reconstruction incrementally. Great work by Yushi @GROS17121524 and Yihang @TheYihangLuo ! Project: nirvanalan.github.io/project… arXiv: arxiv.org/abs/2508.10893 Code: github.com/NIRVANALAN/STream… See a streaming reconstruction of our S-Lab lobby below!
5
55
2
311
32,803
Yihang Luo retweeted
STream3R Scalable Sequential 3D Reconstruction with Causal Transformer
4
13
109
12,984
🔬 Our study introduces "Upscale-A-Video," a text-guided latent diffusion framework for video upscaling. It ensures temporal coherence locally & globally, balancing fidelity and quality. 🚀 Project page: shangchenzhou.com/projects/u… 💻 GitHub: github.com/sczhou/Upscale-A-… 🎥 Video: youtu.be/b9J3lqiKnLM @ShangchenZhou @peiqing001 @Iceclearwjy @TheYihangLuo
11
50
6
292
52,709
Our #ProPainter👨‍🎨 @huggingface demo is finally live! Remove any object with just a click. Dive in and give it a try! 🛹 Access the demo here: huggingface.co/spaces/sczhou…
#ICCV2023 Introducing 𝐏𝐫𝐨𝐏𝐚𝐢𝐧𝐭𝐞𝐫 🔥 again – our new solution for video inpainting🎨. Use it for object removal and seamless video completion. Feel free to try it out! Project: shangchenzhou.com/projects/P… Github: github.com/sczhou/ProPainter Paper: huggingface.co/papers/2309.0…
11
14
2
63
38,285
Yihang Luo retweeted
🌟Do you feel these bright spots quite annoying in smartphone photography? 🌟Our highlight paper proposes the first learning-based method specialized for this problem. Come and check in this afternoon #CVPR2023 ! ​ 📍 Location: West Exhibit Hall #17 ⏰ Time: 04:30 PM - 06:30 PM
4
1
15
1,777