AIDB Daily Papers
AutoTrainess:言語モデルによる自律的な言語モデル改善手法
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- 言語モデルが自律的に学習の計画から評価までを行うためのエージェント基盤AutoTrainessを提案した。
- CLI環境での操作に頼らず、人間が持つ学習の知見をワークフローやルールとして明示的に組み込んだ点が新しい。
- ベンチマークにおいて従来手法を上回る性能を達成し、複数のモデルで学習効率の向上を確認した。
Abstract
Training language models (LMs) remains a highly human-intensive process, even as frontier language model agents become increasingly capable at software engineering and other long-horizon tasks. A central challenge is that autonomous post-training is not just a coding problem: it requires the agent to repeatedly plan iterations, construct benchmark-aligned data, run stable training jobs, evaluate checkpoints, and preserve experiment state across many hours of interaction. We present AutoTrainess, a LM agent that exposes these operations as a repository of agent-computer interfaces for planning, data preparation, training, evaluation, and logging. Rather than leaving the agent to operate in a raw CLI environment with an underspecified action space, AutoTrainess externalizes prior human experience as explicit workflows, rules, and execution constraints that guide the agent toward effective and reliable training behavior. On PostTrainBench, AutoTrainess consistently outperforms CLI-only baselines, achieving 26.94 average score with GPT-5.4 (Codex) versus 23.21 for CLI-only. It also generalizes across models and harnesses, improving DeepSeek-V4-Flash (OpenCode) from 12.13 to 19.58.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: