AIDB Daily Papers
SAGE:LLM推論のためのマルチエージェント自己進化
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- SAGEは、少量の初期データのみでLLMの推論能力を自己進化させる新しいフレームワークを提案した。
- 明示的な計画性と品質管理を導入し、長期的な多段階推論における安定性を高めた点が重要である。
- 数学とコード生成のベンチマークで、Qwen-2.5-7Bモデルの性能を大幅に向上させることに成功した。
Abstract
Reinforcement learning with verifiable rewards improves reasoning in large language models (LLMs), but many methods still rely on large human-labeled datasets. While self-play reduces this dependency, it often lacks explicit planning and strong quality control, limiting stability in long-horizon multi-step reasoning. We present SAGE (Self-evolving Agents for Generalized reasoning Evolution), a closed-loop framework where four agents: Challenger, Planner, Solver, and Critic, co-evolve from a shared LLM backbone using only a small seed set. The Challenger continuously generates increasingly difficult tasks; the Planner converts each task into a structured multi-step plan; and the Solver follows the plan to produce an answer, whose correctness is determined by external verifiers. The Critic scores and filters both generated questions and plans to prevent curriculum drift and maintain training signal quality, enabling stable self-training. Across mathematics and code-generation benchmarks, SAGE delivers consistent gains across model scales, improving the Qwen-2.5-7B model by 8.9% on LiveCodeBench and 10.7% on OlympiadBench.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: