Staff Algorithm Expert @Ali_TongyiLab, Ex-Senior Research Scientist @SFResearch (SG), Ph.D. in CS @cuhkcse

Singapore
Joined March 2019
🚀 Excited to share OpenGCUA, the latest work from our MAI-UI team! OpenGCUA is an open, community-driven initiative to build and continuously advance the full stack for Generalist Computer-Use Agents (GCUA)—bringing GPT-6-style CUA capabilities to the open-source community.
GPT-6 made computer use the frontier. We make it open. 🚀 Meet OpenGCUA, an ongoing project to open the full stack for generalist computer use. All 8 frontier models improve on OSWorld-v2, GPT-6 Astra included. On average: +19.6 points and 53% fewer steps than batched GUI-only. The idea: let the model decide how to observe, act and organize its work, across visual and programmatic interfaces. We call such a system a generalist computer-use agent (GCUA). Two designs make it work: ⚙️ Code execution: code becomes the model's only action space. Each step is one program that can combine GUI actions, shell commands and app APIs, with loops and checks 🧭 Harness-to-model decision transfer: As models become more capable, we envision progressively shifting selected workflow decisions from fixed harness rules to the model Open today: 📄 Tech report 🧠 OpenGCUA harness and prompts, with an OSWorld integration example 📜 Evaluation trajectories of all 8 models 💻 macOS real-device harness, as a native menu-bar app (preliminary) 🔌 Cross-Device SDK (preliminary) 🧪 7 interactive labs and real-Mac demos Paper: arxiv.org/abs/2610.22200 Code: github.com/Tongyi-MAI/OpenGC… Labs and demos: tongyi-mai.github.io/OpenGCU… A closer look below 🧵
1
3
120
WANG Yue retweeted
Jev @typesafeai gui agent demos from @trycua, @nielsmdt99 and others look insanely fast.🔥 But does that speed translate into reliable task completion on mobile-use? We tested the pair on MobileWorld’s 117 GUI-only tasks where Qwen3.8-Max plans, Jev acts (task demos below). 🧵
5
5
1
14
298
WANG Yue retweeted
Qwen-UI-Agent Technical Report Toward Next-Generation Real-World Centric Foundation GUI Agents paper: huggingface.co/papers/2607.2…
6
19
57
20,123
🚀 Excited to share our latest work on foundation GUI agents! We present Qwen-UI-Agent, a real-world centric foundation GUI agent spanning mobile, computer-use, web, and DeepSearch environments. 🌐 Project Page: tongyi-mai.github.io/Qwen-UI… #LLM #Agent #GUI #tech
3
8
33
2,569
Hey @OpenAI, we've seen the future of mobile agents in GPT-5.5! The performance on MobileWorld is absolutely world-class. We believe it's time to set this as the new gold standard for mobile GUI evaluation. 📱✨ #OpenAI #GPT55 #MobileWorld #AI #LLM #AutonomousAgents #FutureTech
46
📊 Top-3 on MobileWorld: 🥇 Seed-2.0-Pro — 63.2 🥈 Claude Opus 4.7 (@AnthropicAI) — 56.4 🥉 Kimi K2.6 (@Kimi_Moonshot) — 55.6 Where are mobile-use agents headed? Our latest blog post digs in 🔍 (Opus 4.7 vs 4.6 & K2.6 vs 2.5) tongyi-mai.github.io/MobileW…
1
55
🎉 MobileWorld accepted to ACL 2026! With AndroidWorld saturating, we built MobileWorld as a more discriminating online mobile-use agent benchmark. 5 months in, it's becoming a go-to eval for mobile scenarios — including the recent Doubao-Seed-2.0-lite release. ✨ @ByteDance_CN
1
1
94
📊 Top-3: 🥇 Seed-2.0-Pro (behind Doubao's AI phone) 🥈 Claude Opus 4.7 @AnthropicAI 🥉 Kimi K2.6 @Kimi_Moonshot Full leaderboard 👉 tongyi-mai.github.io/MobileW…
1
41
We're also expanding the platform with trajectory inspection, head-to-head model comparison, and more on the way. Feedback very welcome 🙏 #ACL2026 #LLMAgents #AIBenchmarks
39
MAI-UI is officially live! 🚀 We’re releasing a family of foundation GUI agents (2B to 235B) setting new SOTA benchmarks in GUI grounding & mobile navigation. 🏆 #1 on ScreenSpot-Pro (73.5%) 🏆 #1 on AndroidWorld (76.7%) 🔗 tongyi-mai.github.io/MAI-UI-…
1
1
1
127
2/3 What’s under the hood? Our research focuses on: 🧠 Hybrid MCP tool-use & Active User Interaction ☁️ Device-Cloud Collaboration 🔄 Large-scale Multi-turn online RL We’ve scaled from 2B to 235B, and we’re open-sourcing the 2B and 8B models! 🔓 🔗 github.com/Tongyi-MAI/MAI-UI
1
35
3/3 This SOTA is a direct result of months of dedication and brilliant R&D. I’m incredibly lucky to lead such a talented group of innovators. We did it! 🏆 🚀 WE ARE HIRING! Want to build the future of GUI agents? DM me. 📜 Report: arxiv.org/abs/2512.22047 #Hiring #GUIAgents
24
Introducing 🔥BLIP-Diffusion🔥, a novel method for enabling Text-to-image Diffusion models with multimodal controllable generation/editing, powered by BLIP-2 pre-trained text-aligned subject representation. Paper: arxiv.org/abs/2305.14720 Project: dxli94.github.io/BLIP-Diffus… (1/n)
3
56
4
188
40,621
Excited to introduce our 🔥CodeT5+🔥, a new family of open-source code LLMs for both code understanding and generation, achieved new SoTA code generation performance on HumanEval, surpassing all the open-source code LLMs and the closed-source OpenAI code-cushman-001 model!
Introducing 🔥CodeT5+🔥, a new family of open-source code LLMs for both code understanding and generation, achieved new SoTA code generation performance on HumanEval, surpassing all the open-source code LLMs. Paper: arxiv.org/pdf/2305.07922.pdf Code: github.com/salesforce/CodeT5… (1/n)
1
3
13
809
A new member in the BLIP family: 🔥InstructBLIP🔥, a vision-language instruction tuning framework. InstructBLIP achieves SoTA zero-shot performance with various advantages over other multimodal models such as GPT-4! Github: github.com/salesforce/LAVIS/… Paper: arxiv.org/abs/2305.06500
15
107
11
423
95,488
DeepTime has been accepted to #ICML2023 ! We use deep time-index models and formulate forecasting as meta-learning and obtain state of the art results! Paper: arxiv.org/abs/2207.06046 Blog: blog.salesforceairesearch.co… Code: github.com/salesforce/DeepTi…
Time-series forecasting methods perform poorly on long sequences when data changes over time. DeepTime overcomes this issue by using forecasting-as-meta-learning on deep time-index models. Result: state-of-the-art performance and a highly efficient model. blog.salesforceairesearch.co…
6
27
3,443
Happy to share that our BLIP2 paper has been accepted by #ICML2023! arxiv.org/abs/2301.12597 Congrats to our amazing team and coauthors for a very high-impact work in multimodal generative AI! Our work is open-source and publicly available in our LAVIS library.
2
25
150
16,045
Aran Komatsuzaki giving walkthroughs of the codeRL paper before the author arrives. After 10 minutes of SBFing his way into answering poster questions he revealed he was not the author and everyone lost their mind (Poster 138 #NeurIPS2022)
9
33
12
567
Check out our new research work for code generation using RL and pretrained LMs! Code & models are open-source: github.com/salesforce/CodeRL Great thanks to my amazing fellow researchers at Salesforce @LHung1610 @AkhileshGotmare @silviocinguetta @stevenhoi
CodeRL advances program synthesis by integrating pretrained language models + deep reinforcement learning. Using unit test feedback in model training and inference + an improved CodeT5 model, it achieves SOTA results on competition-level programming tasks. blog.salesforceairesearch.co…
9
Meet CodeT5 - the first code-aware encoder-decoder pre-trained model that achieves SoTA on 14 sub-tasks in CodeXGLUE! Learn how it’s disrupting software development. Blog: blog.einstein.ai/codet5/ Paper: arxiv.org/abs/2109.00859 GitHub: github.com/salesforce/CodeT5 #codeintelligence
3
20
3
47