AIDB Daily Papers
UniSteer:活性化空間におけるテキスト誘導フローマッチングによる汎用LLM制御
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- テキスト条件に基づいて活性化空間における条件付き分布を学習するUniSteerを提案した。
- 既存手法の固定方向やタスク固有モジュールに依存せず、汎用的な制御と分類を可能にする点が重要である。
- 実験の結果、UniSteerは振る舞い制御、真実性誘導、細粒度概念誘導、複数制約指示追従、活性化空間分類を統一的にサポートした。
Abstract
Activation-based control steers large language models (LLMs) by intervening on their internal representations during inference, and has emerged as an effective paradigm for controlling behaviors such as persona and style. However, existing methods often rely on fixed steering directions or task-specific intervention modules, making them difficult to adapt to fine-grained concepts and compositional constraints. We propose UniSteer, a text-guided activation flow matching model that learns a conditional distribution over residual-stream activations from natural-language conditions. Instead of fitting a separate intervention for each target behavior, UniSteer learns a universal conditional velocity field in activation space. At inference time, UniSteer performs flow inversion by partially transporting a source activation toward a latent state and regenerating it under a target textual condition before injecting it back into the frozen LLM. The same conditional model supports activation-space classification by selecting the textual label with the lowest reconstruction energy. Experiments on three target LLMs show that UniSteer provides a unified interface across behavioral control, truthfulness steering, fine-grained concept steering, multi-constraint instruction following, and activation-space classification.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: