Pyuyi (@Pyuyi2333) header
Pyuyi (@Pyuyi2333) profile picture

mmm(Pyuyi) | (She/her) |math|AI Interpretability|Causal Inference| looking for PHD/Intern/RA

Joined August 2026
Photo by Pyuyi (@Pyuyi2333)Photo by Pyuyi (@Pyuyi2333)Photo by Pyuyi (@Pyuyi2333)Photo by Pyuyi (@Pyuyi2333)Photo by Pyuyi (@Pyuyi2333)Photo by Pyuyi (@Pyuyi2333)Photo by Pyuyi (@Pyuyi2333)
Hi, there! I’m Pyuyi, mmm as well (she/her). This account is for academic sharing. What I mainly post here: 1. Paper notes and thoughts on AI interpretability, causal inference, math and learning theory. 2. Summaries and discussions of recent work from venues — including causal model reduction, RL interpretability, topology & replicability, latent reasoning as dynamical systems, etc. 3.Occasional updates on my own related work and open-source experiments. If you’re interested in math, AI interpretability, or causal inference, follow@Pyuyi2333--would love to chat and exchange iddeas!
5
1
13
2,832
After studying DeepSeek-R1 671B and GPT-OSS 120B, comparing internal activation probes, forced early answers and text-based chain-of-thought monitoring, the researchers from ICML26 figure out that a model's eventual answer can often be decoded from its activations long before its verbal reasoning reveals that answer, especially on easier MMLU questions. Yet the distinction matters: on harder GPQA-Diamond problems, backtracking and apparent “aha” moments largely coincide with genuine shifts in the model's internally decoded beliefs. Using probe-guided early exits, the researchers reduce reasoning tokens by up to 80% on MMLU and 30% on GPQA-Diamond, while maintaining similar accuracy. The broader implication is that visible reasoning length is not necessarily a reliable measure of useful computation or internal uncertainty and this connects mechanistic interpretability with sequential decision theory, adaptive computation and AI safety monitoring. However, decoding an answer early does not prove the model has irreversibly committed to it and results across two model families cannot establish universal reliability. The next challenge is developing calibrated internal stopping criteria that distinguish genuine uncertainty from redundant reasoning, while detecting systematic mismatches between expressed reasoning and internal beliefs. Probably efficient reasoning should depend less on how many tokens a model produces and more on whether its beliefs are still changing.
5
1,052
Lately, I've been reading quite a few papers and theories on AI Alignment. I usually feed the papers and my notes into an AI, then try to make sense of the insights it gives me. And as we all know, AI has this notoriously weird and sometimes almost incomprehensible way of writing. But if I want to read papers more efficiently, I guess I just have to put up with it and try my best to understand... Had a bit of Spritz tonight, and maybe it was the alcohol talking, but a thought suddenly crossed my mind: **isn't this, in some sense, also a form of Alignment? Except that this time, it's humans being forced to align with the way AI thinks...** It reminded me of a system-based web novel where the protagonist was given a mission involving an "intelligence crisis": Prevent the destruction of civilization. However, unclear about which civilization whether make human civilization align with an intelligent civilization to save the intelligent one or other. Would that also count as a way of avoiding disaster...? (MOSS, just how far can your eyes see...? (Wait, what am I even talking about... At this point, humanity's obsession with efficiency seems almost unstoppable. Just like how we probably can't imagine going back to writing all our code manually, our pursuit of technological "prosthetics" seems pretty much inevitable. Whether it's giving ourselves "three heads and six arms," or implanting chips into our brains to help us learn, process information, or control things remotely, it all feels like a natural direction for us to take. And when that happens, it'll be hard to say whether it's the human brain controlling the chips and cybernetic limbs, or the chips and limbs controlling the human brain. (Just think of Doctor Octopus...) Ethics committees might eventually become completely meaningless. People with cybernetic enhancements would gradually outcompete and replace those without them, both at work and in education, much like how people who know how to use AI are already starting to replace those who don't. That would inevitably give rise to underground markets and illegal clinics, and just like that, the cyberpunk era begins. Meanwhile, these "prosthetics" would only widen the gap between the rich and the poor, pushing society closer and closer to the kinds of worlds we've seen in cyberpunk fiction. And here's another thought: while humans are gradually becoming more like machines, humanoid robots are becoming more and more like humans. So who's to say that a human body with most of its parts replaced by cybernetics isn't essentially a humanoid robot? With AI evolving so rapidly and accelerating technological progress along the way, I feel like all of this is becoming increasingly foreseeable. Maybe some of it will even happen within our lifetimes... Ah, wouldn't that be something. I really, really want to go out there, explore the universe, and see the stars...
3
910
Language models learn to predict sequences, while accurate prediction alone does not guarantee good decisions against adaptive adversaries. The authors from ICML26 establish a striking theoretical connection: with access to the full interaction history, every sequence distribution is exponentially close in total variation distance to one that induces low-regret decision-making. In principle, prediction quality and adversarial robustness need not fundamentally conflict. Yet finite context windows introduce an impossibility result: certain distributions remain a constant distance from every low-regret distribution. The paper also proves that modest context expansion can restore near-optimal regret guarantees, and that the full-history construction can be implemented by adding a constant number of Transformer layers, supported by preliminary experiments with small models. The deeper insight is that the difference between predicting well and deciding well may lie in the structure of the prediction algorithm rather than its training objective alone. This connects language modeling with online learning, game theory and computational complexity. However, the guarantees concern specific adversarial decision settings, not general-purpose LLM agents. The following challenge might be building finite-context agents that retain predictive performance while achieving provable low regret during real tool-mediated interactions. Perhaps better decision-making requires not only more accurate world predictions, but algorithms that remain effective when those predictions are strategically challenged. arxiv.org/abs/2603.28499
2
15
75
4,845
Standard RLVR methods such as GRPO learn primarily from outcome rewards, leaving the internal causes of failure largely unaddressed. Self-Distillation Policy Optimization (SDPO) raised in ICML26 takes a different approach: the model revisits its own failed attempt with environmental feedback, then distills its feedback-informed next-token distribution back into the original policy. No external teacher is needed. On chemistry reasoning with Olmo3-7B, SDPO reaches GRPO's accuracy approximately 6× faster in wall-clock training time. On difficult LiveCodeBench problems, test-time self-distillation achieves comparable solution-discovery probabilities with up to 3× fewer attempts. The deeper insight is that a model's ability to recognize mistakes after receiving feedback can become a dense learning signal rather than remaining a temporary in-context capability. This connects reinforcement learning with KL-based distillation, credit assignment, and amortized inference. However, the method depends on reliable feedback and sufficiently capable self-teachers, while additional computation and out-of-distribution generalization remain open questions. The next challenge is integrating self-distillation with persistent agent memory and tool feedback, allowing failures to produce transferable improvements rather than merely triggering another attempt. arxiv.org/abs/2601.20802
11
22
2
228
14,366
Conventional in-context learning faces an architectural limitation: simulating larger neural networks or more optimization steps generally requires greater model depth or width. The authors from ICML26 establish a theoretical alternative: a constant-depth Transformer can simulate arbitrarily many gradient descent steps on an N-layer neural network by unfolding computation into its generated sequence. Their key innovation combines intermediate computational states with dynamic attention masking, avoiding unnecessary attention operations and improving theoretical computational complexity by an O(N) factor over the previous best construction. Numerical experiments support the analysis. The deeper connection is to algorithm simulation, computational complexity, and iterative optimization: a model's effective computational capacity depends not only on its parameters, but also on how computation is organized over time. This suggests a possible route toward more powerful test-time learning without proportionally expanding network size. However, the guarantees concern specific mathematical constructions, not arbitrary pretrained LLMs, and theoretical complexity improvements do not establish equivalent hardware speedups. The next question is whether Transformers can learn these optimization procedures autonomously and transfer them to real neural network training or online agent adaptation. Perhaps the future of reasoning models lies as much in learning better computational processes as in scaling their parameters. openreview.net/forum?id=uZ8J…
2
8
77
3,572
I'm going to London in November for participating in Intensive Course about AI Alignment in @Iliad_research. Coffeechats are welcomed and we have already some booked chats with friends in UCL and IC.
9
800
Most representation learning methods rely on prediction objectives, external rewards or fixed datasets. This paper from ICML26 explores a different principle: an agent should represent the world according to its capacity to influence it. Building on information-theoretic empowerment, the authors maximize mutual information between an agent's skills and their future outcomes. Their analysis reveals two complementary representations: a forward representation describing which outcomes can be influenced and a backward representation describing how states can be reached. Under specified assumptions, both become invariant to control-irrelevant information without requiring task rewards or expert demonstrations. In experiments involving Point-Maze, Ant, and visual manipulation, learned representations show at least 1000× greater sensitivity to control-relevant state variables than irrelevant noise. Linear probes also recover the true coordinates of a noisy maze with R² approaching 1, while downstream agents achieve substantially better control performance than baselines using noisy observations directly. The deeper implication is that intelligent perception may emerge from intervention rather than prediction alone. This connects reinforcement learning with mutual information, causal representation learning, and control theory, suggesting a route toward task-independent world models. However, the theoretical guarantees rely on specific assumptions and fully observable environments; learning controllable features does not establish recovery of the complete causal structure. The next question is whether the same principle can help partially observable or language-model-based agents develop transferable causal representations through tool use and environmental interaction. Perhaps building more capable agents requires teaching them not only to predict what happens next, but to discover which aspects of the future they can actually change. arxiv.org/abs/2605.30656
1
11
2
76
4,048
Standard RLVR maximizes expected correctness, but this objective can provide weak learning signals for problems the model rarely solves. The authors from ICML26 oral show that expected-reward RL captures only the first-order term of a more fundamental objective: the log-likelihood of generating correct solutions. Their proposed MaxRL bridges that gap by expressing maximum-likelihood gradients through a weighted combination of pass@k objectives. Surprisingly, the practical modification is almost trivial: normalize successful trajectory gradients by the number of successes rather than the total number of samples. The resulting estimator is unbiased for a truncated likelihood objective and approaches maximum-likelihood optimization as sampling compute increases. In Qwen3 mathematical reasoning experiments, MaxRL improves solution coverage while maintaining competitive pass@1 performance, requiring up to approximately 19.2× fewer test-time samples than GRPO to reach comparable success rates in selected settings. The deeper insight is that an optimization objective determines not just what a model learns, but which problems receive enough gradient signal to become learnable. This connects reinforcement learning with maximum likelihood, logarithmic scoring rules, and gradient geometry. However, the method assumes reliable binary verification, cannot directly learn from prompts producing zero successful trajectories, and incurs additional training costs. The next challenge is combining adaptive sampling, difficulty estimation, and likelihood-based optimization to help models learn from increasingly rare successes. Perhaps better reasoning RL begins with deciding how learning signals should be distributed—not simply how rewards should be maximized. arxiv.org/abs/2602.02710
15
93
5,199
Most self-improving agents accumulate trajectories, retrieve past experiences and refine their behavior within a manually designed memory system. MemEvolve from ICML26 challenges that assumption by introducing two coupled processes: evolving what an agent remembers and evolving how its memory works. The authors organize 12 representative memory systems into four components—encoding, storage, retrieval, and management—then use trajectory analysis, candidate generation, and iterative evaluation to search for better architectures. Across four agent benchmarks, the method reports performance improvements of up to 17.06%, with evidence that some evolved memory architectures transfer across tasks and backbone models. The deeper insight is that an agent's learning mechanism can itself become an optimization target. This connects agent memory with meta-learning, bilevel optimization and evolutionary search: one process accumulates useful experience, while another improves the machinery responsible for learning from it. Unlike ordinary retrieval-augmented memory, the improvement operates at the level of system design. However, benchmark-specific architectural gains do not establish open-ended recursive self-improvement and evaluation overfitting, search costs, and long-term stability remain unresolved. The next challenge is whether agents can jointly evolve memory, tool-use policies, and experience-transfer mechanisms while demonstrating measurable improvements in future learning efficiency. Perhaps scalable self-improvement requires not just learning more from experience, but learning better ways to learn. arxiv.org/abs/2512.18746
1
1
4
719
Pyuyi retweeted
非常赞同,我觉得 agent 开发就像 C 和 Python 一样,属于基本技能。 我甚至还有个暴论,编译原理、操作系统、计算机体系结构,这三门计算机本科最硬核的课,将逐渐让位于 agent、LLM、infra 三门核心课(这也是我翻译《图解大模型》和写 agent/infra 两本书的原因)。 传统软件,工程师接触的是编程语言,代码跑在编译器和运行时上;软件是在操作系统上跑的;操作系统又是基于体系结构。LLM 时代,工程师接触的是 token,agent 跑在 harness 上;agent 是在 LLM 上跑的;LLM 又是跑在 infra 上的。
我觉得 agent 开发不是下一门显学,而是下一项即将普及到失去技术溢价的通用技能。 像 compact eval 上下文管理之类这些东西,很快就会像当年的前端八股文一样标准化。 而 agent 最终也会成为所有技术人员的基本工具,而不是少数人的专业技能。古法时代所有人都会做网页,所以前端不值钱呀 🫣
54
133
11
884
85,999
Conventional zeroth-order optimizers such as MeZO estimate gradients through random parameter perturbations, wasting evaluations on directions unrelated to meaningful updates. AGZO from ICML26 exploits a simple but powerful geometric property: the weight gradient of a linear layer lies in the subspace spanned by its input activations. Rather than sampling perturbations across the entire parameter space, it extracts low-rank activation subspaces during forward computation and restricts gradient estimation to those directions. Under spectral concentration assumptions, the authors prove better expected alignment with the true gradient than isotropic perturbations. On Qwen3-0.6B, AGZO achieves 89.2% accuracy on CB versus 80.3% for MeZO, while enabling Qwen3-4B fine-tuning in a hardware setting where full first-order training runs out of memory. The deeper insight is that avoiding backpropagation does not require treating neural networks as structureless black boxes. Forward activations already reveal useful information about optimization geometry, connecting zeroth-order learning with randomized linear algebra and low-dimensional representation structure. However, the method remains substantially more iteration-intensive than first-order training, and its advantages have not been established at frontier pretraining scale. The next question is whether adaptive activation subspaces can reduce both gradient-estimation noise and the number of forward evaluations required for effective learning. Perhaps the next generation of optimizers will use forward computation not merely to evaluate loss, but to determine where parameter updates should occur. arxiv.org/abs/2601.17261
2
7
1
49
3,689
While I was tinkering with a visual novel on my Mac, I suddenly had an idea that needed an experiment to test it. The idea and discussion were all in my Mac’s Codex conversations, but the Windows machine was the one connected to the lab VPN and able to reach the server. So I wondered: could Dot on my Mac read the discussion, hand the task to Codex on Windows, and let Windows SSH into the server to run it? It turned out that the available integrations couldn’t connect that whole workflow at the time: the Dots on the two computers couldn’t coordinate directly, and Dot couldn’t directly read the existing Codex Work/Chat conversations either… So I built this little project. If you like it, consider leaving a little ⭐: DotControl: One Dot. Multiple computers working together. We increasingly work across multiple computers: a Mac for conversations and organizing ideas, a Windows machine for development environments, applications, and network access. When tasks and context are scattered across devices, we end up switching computers, copying instructions, and hunting down conversation history. DotControl helps these devices work together: give Dot a task on one computer, let another computer execute it in its own environment, and bring the results back. It connects each device to Dot through a private MCP plugin → OpenAI Secure MCP Tunnel → a local agent on the target computer, without requiring a self-hosted cloud server. Execution happens on the target computer. Terminal tasks go to its official Codex installation, desktop actions use a controlled executor, and local conversations are returned through read-only access within the sharing scope configured by the user. Login credentials stay on the target device, permissions are configured by the user, and there are explicit controls to pause access, revoke it, or cancel tasks. For computer use, the project has demonstrated calculator operations and screenshot return across Windows and Mac computers. It has also completed a workflow where Dot stays connected to the Mac, delegates a read-only terminal task to Windows Codex, and receives the result. Installers are available for Windows, Apple Silicon Macs, and Intel Macs, with a console for managing connections, Codex, and conversation sharing. You can submit remote tasks, check progress, continue conversations, and choose which local chats Dot may read. DotControl is making cross-device collaboration a natural part of the workflow: express your intent here, let the right computer execute it, and bring verifiable results back here. github.com/VeraPyuyi/DotCont…
2
4
1,114
TLDR: DotControl is an open-source tool for cross-computer collaboration. Ask Dot on one computer to delegate tasks to Codex on another, read conversations you’ve chosen to share, and perform controlled desktop actions. It supports Windows and macOS without a self-hosted cloud server—connecting tasks, context, and results across devices.
182
Most reinforcement learning with verifiable rewards (RLVR) reduces an entire reasoning attempt to a single success or failure signal, discarding information contained in compiler errors, failed tests and other environment feedback. The authors introduce Self-Distillation Policy Optimization (SDPO) in ICML26, which lets a model reconsider its predictions after observing feedback, then distills those feedback-conditioned predictions into its original policy. Instead of learning exclusively from sparse outcome rewards, the model receives dense token-level supervision from its own informed predictions. Across scientific reasoning, tool use and competitive programming, SDPO improves learning efficiency over strong RLVR baselines. On difficult binary-reward problems, its test-time variant achieves comparable solution-discovery probabilities with 3× fewer attempts. The deeper insight is that a model's ability to recognize mistakes can become a mechanism for improving its future behavior. This connects self-distillation with policy improvement, amortized inference, and continual learning, suggesting a promising direction for agents that learn from their interactions. But self-generated supervision is only useful when the underlying feedback is trustworthy and the model can interpret it correctly. Otherwise, distillation may reinforce existing errors. The next question is whether tool feedback, environmental observations, and persistent memory can be converted into a unified learning signal that enables agents to accumulate genuinely transferable capabilities over time. arxiv.org/abs/2601.20802
4
1
45
2,898
The paper from ICML26 asks a fundamental question: can an AI reason causally about a world whose objects and relationships have changed? Classical structural causal models typically assume a fixed set of variables, but real environments rarely preserve that structure. The authors prove that observations from familiar configurations may be insufficient even to identify the observational distribution of an unseen configuration. Their solution, relational structural causal models (RSCMs), introduces graphical identification conditions that enable causal reasoning across changing object configurations under explicit assumptions, including certain forms of hidden confounding. In simulated traffic environments, their neural implementation reduces causal-effect estimation error by roughly 100× in some identifiable settings, successfully transferring knowledge between different arrangements of cars, pedestrians and traffic signals. The deeper contribution is a mathematical bridge between causal inference and compositional generalization, connecting Pearl’s causal framework with relational learning, graph neural networks and object-centric world models. It suggests that generalizable intelligence may require learning not just representations of objects, but the causal mechanisms governing their interactions. The limitations matter: the theoretical framework relies on assumptions including finite discrete variables, bounded relational neighborhoods and restrictions on cross-object hidden confounding, while experiments remain largely synthetic. The next challenge is learning such structures from high-dimensional observations and using them for planning and reinforcement learning. Perhaps the most important thing a world model should generalize is not the world it has seen, but the causal rules that generate possible worlds. arxiv.org/abs/2606.14892
4
325
Pyuyi retweeted
可以水群、 然后可能我会放一些我知道的关于AI的workshop通知,大家可以自行选择性的报名参加一些,也可以稍微的讨论一起学习一下 还可以约游戏)) 更多功能还在探索中qaq
4
1
13
1,318
The paper from ICML26 challenges a fundamental assumption in RL: why optimize the agent while treating its environment and reward function as fixed? RLAnything replaces that separation with a joint optimization loop. The policy learns from both process-level and outcome feedback, the reward model improves through consistency signals and the environment adapts its training tasks using critic feedback. Rather than simply adding more training examples, the system continuously changes what the agent learns, how its behavior is evaluated and which experiences it encounters next. The authors report improvements of 8.5% on OSWorld, 21.2% on AlfWorld, and 12.1% on LiveBench in their evaluated model settings, with training code publicly available. The deeper contribution is a shift from policy optimization to learning-system optimization, connecting agentic RL with bilevel optimization, active learning, automated curriculum design and adaptive control. This offers a concrete research direction for recursive self-improvement: an agent might improve not only its behavior but also the training experiences and feedback mechanisms responsible for future improvements. However, benchmark gains do not establish sustained self-improvement. Jointly evolving rewards and environments can create dangerous feedback loops in which biased evaluations reinforce increasingly misleading training tasks. The next question is whether independent verification, principled improvement criteria and compute-aware environment generation can make this process stable and genuinely transferable. If so, the next frontier in agent training may be optimizing the entire policy–reward–environment ecosystem, rather than the neural network alone. arxiv.org/abs/2602.02488
1
2
354