AIDB Daily Papers
AIエージェントのスキル評価と進化:フレームワークとベンチマークの現状
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- 本研究は、AIエージェントのスキル構築、評価、展開における進化の現状を体系的に調査した。
- スキル評価の重要性が増す中、孤立したスキル作成から評価駆動型の自動進化へのパラダイムシフトを分析した。
- 6つのベンチマークカテゴリを分析し、スキル研究の進展に向けた課題と将来の方向性を特定した。
Abstract
The growth of agent skills has transformed how agentic systems are built, evaluated, and deployed. As skill libraries continue to scale, rigorous evaluation becomes critical to ensuring their utility, quality, and safety in real-world applications. Consequently, the field is undergoing an emerging paradigm shift from isolated skill creation to automated, evaluation-driven skill evolution. In this survey, we systematically examine the landscape of skill evolution and evaluation beyond foundational skill creation. We categorize evolution into four distinct paradigms, spanning execution feedback, trajectory distillation, compression, and reinforcement learning, showing how each element contributes to improving skill utility and reliability. We also provide an analysis of six skill-centric benchmark categories, identifying structural gaps in benchmark coverage, trade-offs, and metric richness to advance skill research. Finally, we identify open directions for building skill ecosystems that are generalizable, efficient, and verifiably safe. The project URL is https://github.com/Cassie07/AgentSkill_Survey
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: