AIDB Daily Papers
「いつ尋ねるべきかを知る」:階層的言語エージェントのための自己ゲーティング型明確化手法
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- 本研究では、階層的推論における情報不足による誤りを防ぐため、エージェントの行動空間に「質問」を組み込むACTION-RATING手法を提案した。
- この手法により、エージェントは行動と質問を直接競合させ、必須的または機会的な情報探索を自律的に行うことが可能となった。
- 大規模な関税分類タスクにおいて、提案手法は情報探索の有効性を大幅に向上させ、エージェントの推論能力を改善することが示された。
Abstract
In hierarchical reasoning, failures often originate at intermediate decision points where the agent commits to a wrong branch without recognizing that it lacks critical information. Rather than treating clarification as an external uncertainty trigger, we propose ACTION-RATING, a formulation that places it inside the agent's action space on a shared ordinal scale with navigation, so that asking competes directly with acting at every decision point and help-seeking becomes observable at intermediate states. Two structurally distinct information-seeking modes emerge from the agent's own ratings: mandatory (no viable branch) and opportunistic (residual uncertainty despite a leading candidate). On Harmonized Tariff Schedule classification (30,000-node taxonomy, three benchmarks, 9~LLMs across 4 families), we observe a regime shift from mandatory to opportunistic clarification, with Information-Seeking Effectiveness (ISE), a local diagnostic defined as the fraction of help interactions followed by a correct next navigation step (not a final-task metric), rising from 50% to 74%. Three diagnostic contrasts fail to reproduce this structure. A separability test shows that the information-seeking pattern (mode split, ISE ranking) persists when answer quality is degraded (-18.8% accuracy), supporting an empirical separation between where an agent seeks help and the quality of the help it receives. Under the controlled answer channel, accuracy gains reach +16.2% at 10-digit; we read this as an upper bound on what better localization could unlock, not a deployment estimate.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: