AIDB Daily Papers
Skills-Coach:学習不要なGRPOによる自己進化型スキル最適化フレームワーク
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- LLMエージェントのスキル自己進化を促進する自動化フレームワーク「Skills-Coach」を提案しました。
- 多様なタスク生成、軽量なプロンプト・コード最適化、比較実行、追跡可能な評価により、スキルの能力向上を目指しました。
- 48個のスキルからなるベンチマークデータセット「Skill-X」で、Skills-Coachが広範なスキル能力の大幅な向上を達成しました。
Abstract
We introduce Skills-Coach, a novel automated framework designed to significantly enhance the self-evolution of skills within Large Language Model (LLM)-based agents. Addressing the current fragmentation of the skill ecosystem, Skills-Coach explores the boundaries of skill capabilities, thereby facilitating the comprehensive competency coverage essential for intelligent applications. The framework comprises four core modules: a Diverse Task Generation Module that systematically creates a comprehensive test suite for various skills; a Lightweight Optimization Module dedicated to optimizing skill prompts and their corresponding code; a Comparative Execution Module facilitating the execution and evaluation of both original and optimized skills; and a Traceable Evaluation Module, which rigorously evaluates performance against specified criteria. Skills-Coach offers flexible execution options through its virtual and real modes. To validate its efficacy, we introduce Skill-X, a comprehensive benchmark dataset consisting of 48 diverse skills. Experimental results demonstrate that Skills-Coach achieves significant performance improvements in skill capability across a wide range of categories, highlighting its potential to advance the development of more robust and adaptable LLM-based agents.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: