AIDB Daily Papers
対話型AIの受動性を打破:潜在的関心事を活用した能動的対話エージェントの開発
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- 本研究では、タスク指向対話におけるAIエージェントの能動性を高めるための新しい手法を提案した。
- 従来のAIは受動的になりがちであったが、ユーザーの潜在的な関心事を学習に組み込むことで、能動的な対話能力を開花させた点が重要である。
- 開発した「Cognitive User Simulator」と「Simulator-Induced Asymmetric-View Policy Optimization」により、説得力のある対話を実現し、AIの応対能力を向上させた。
Abstract
Proactive task-oriented dialogue (TOD), such as outbound sales, demands a persuasive agent that actively probes the user's concerns and steers the conversation toward acceptance within a bounded number of turns. Yet post-trained LLMs are inherently conservative, and reward-shaping RL (e.g., GRPO) struggles since it only re-weights what an already passive policy samples. We show that conditioning on the user's latent concerns unlocks proactive capability that no amount of sampling can undermine, establishing these concerns as a pivotal training-time signal. To operationalize this finding, we build the textbf{Cognitive User Simulator}, which models each user as a stratified persona comprising observable external traits and hidden internal concerns. The simulator produces faithful and diverse interactions, while emitting per-turn state dynamics that track persuasion progress. We then introduce textbf{Simulator-Induced Asymmetric-View Policy Optimization}, which converts the modeled concerns and the simulation state transition into complementary training objectives: (1) emph{Asymmetric On-Policy Self-Distillation} that transfers concern-aware behavior from a privileged view of the same policy into its deployable, conversation-only view; and (2) emph{State-Transition Policy Refinement} ...
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: