AI agents that rewrite themselves are no longer a thought experiment. Systems that update their own prompts, retrain on their own outputs, or redesign their own improvement procedures are already shipping. The open question is not whether agents can self-evolve, but whether any of those updates can be trusted. A new survey from Tencent Hunyuan and collaborators at Zhejiang, Peking, and Tsinghua universities tries to answer exactly that.
The paper, Diving into Reliable Self-Evolving Agents: A Survey, organizes 549 works into a single structural map and introduces two tools practitioners have been missing: a five-level taxonomy of how deeply an agent can modify itself, and a reliability ladder that pairs each level with the kind of external evidence needed to accept an update.
The core problem nobody was naming
Self-evolving agents use information produced during their own execution to revise outputs or modify retained components that shape future behavior. That loop is powerful, but it contains a structural trap: the same system proposing a change can also be the one deciding whether the change was good. The survey's central principle is blunt about this: no update should control the only evidence used to accept itself.
The field had been accumulating techniques, from self-play to skill libraries to reward shaping, without a shared vocabulary for what kind of change was actually happening or what evidence would be sufficient to trust it. That gap is what this survey fills.
Five levels of self-modification
The survey classifies self-evolution into five levels defined by the deepest evolution target whose change takes effect. Think of it as how far down the agent's architecture a change actually reaches:
- L0 , Output-Level: Changes remain inside the current task and do not persist into later independent tasks. Classic examples include Self-Refine, Tree of Thoughts, and chain-of-verification. The characteristic failure is