AIDB Daily Papers
人間とAIの暗黙の理解を測るTUX:人間とAIの暗黙の理解を測る
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- 人間とAIの暗黙の理解を測るための「TUX」という新しい指標を開発した。
- この研究は、明示的な指示なしにAIが人間の評価基準や事前知識にどれだけ沿えるかを測定する点で重要である。
- 人間とAIのペアは、性格特性が近いほど高いTUXを示し、暗黙の理解は個人の特性に依存することが明らかになった。
Abstract
As large language models (LLMs) increasingly act as collaborative partners, human--AI alignment is often evaluated through explicit task success, accuracy, or reward optimization. Yet many collaborative settings depend on tacit understanding: whether an agent can align with a human's evaluative stance or representational priors without clear objectives, communication, or feedback. To study this capacity, we develop a spectrum-placement task inspired by the social party game Wavelength, in which humans and agents independently place concepts along subjective spectra. We operationalize the Tacit Understanding Index (TUX) as a pairwise measure of similarity between human and agent judgments, and evaluate it with 241 human participants and 200 profile-conditioned LLM agents across four models. We find that nearest human--agent pairs in trait space achieve significantly higher TUX, suggesting that tacit alignment is structured by person-level characteristics rather than random similarity. Regression analyses show that TUX becomes more explainable as predictor sets become richer, with individual traits, decision-making styles, and confidence improving over aggregate trait-distance baselines. These findings suggest that tacit understanding between humans and LLMs is measurable, while revealing the limits of profile-based conditioning for capturing deeper representational alignment.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: