AIDB Daily Papers
自己改善AI「SIA」:人間のボトルネックを打破するハーネスと重み更新
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- AIの改善プロセスにおける人間のボトルネックを解消するため、ハーネスと重み更新の両方を同時に行う自己改善AI「SIA」を提案した。
- 従来のAI研究はハーネス更新と重み更新の二分法で進められていたが、SIAはこれらを統合し、より効率的な自己改善を実現する点で重要である。
- SIAは法律文書分類、GPUカーネル最適化、RNAノイズ除去の3分野で、既存手法を大幅に上回る性能向上を達成した。
Abstract
Humans are the bottleneck in building and improving AI. Both the models and the agents that wrap them are written, tuned, and corrected by people. The long-horizon goal of an AI that can figure out how to improve itself remains open. Two largely disjoint research lines attack this bottleneck. The harness-update school has a meta-agent rewrite the scaffold of a task-specific agent (its tools, prompts, retry logic, and search procedure) while the model weights are held fixed. The test-time training school uses hand-written RL pipelines to update the model's own weights on task feedback while the harness is held fixed. These two silos operate in isolation. We propose SIA, a self-improving loop in which a language-model agent (the Feedback-Agent) updates both the harness and the weights of a task-specific agent. We evaluate across three contrasting domains: Chinese legal charge classification, low-level GPU kernel optimisation, and single-cell RNA denoising. Combining both levers outperforms scaffold iteration alone on all three benchmarks. SIA-W+H achieves 25.1% over prior SOTA on LawBench, 12.4% faster GPU kernels than prior SOTA (1,017 vs 1,161 μs), and 20.4% over prior SOTA on denoising. Harness updates make the model agentic, shaping how it searches and acts, while weight updates build the domain intuition that no prompt or scaffold can instil.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: