AIDB Daily Papers
言語を超えたLLMと脳の整合性とその計算的基盤
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- 本研究は、3つの異なる言語で自然な物語を聞いている際の脳活動とLLMの整合性を、全脳エンコーディングフレームワークを用いて調査した。
- 言語を超えてLLMと脳の整合性は広範囲に及び、大脳皮質だけでなく皮質下構造にも見られ、言語間で空間的な重なりが大きかった。
- 整合性は予測誤差や情報圧縮といった計算的指標では説明できず、言語に依存しない語彙的・意味的な対応関係に起因する可能性が示唆された。
Abstract
Large language models (LLMs) reliably predict neural activity during language comprehension and transformer depth has been interpreted as mirroring hierarchical cortical organization. However, it remains unclear whether such alignment extends to subcortical regions, overlaps spatially across languages, and what the computational roots of such alignment are. Here, we used a multilingual, whole-brain encoding framework to examine brain-LLM alignment across three typologically distinct languages: Mandarin, English, and French during naturalistic story listening. Our results show that across languages, transformer-based models predicted activity in a distributed landscape spanning widely distributed cortical functional networks like limbic, ventral attention, default mode network, and subcortical structures. Spatial alignment patterns showed substantial cross-linguistic overlap and remained largely stable across model layers, with limited layer progression consistent with functional cortical hierarchies. Contrary to previous evidence, contextual embeddings did not outperform static embeddings. To test candidate computational explanations, we examined whether layer-wise brain scores reflect surprisal and intrinsic dimensionality, and thereby predictive processing and information compression. Neither of these two computational metrics mirrored neural alignment profiles. Our findings suggest that brain-LLM alignment is spatially robust and cross-linguistically stable but not explainable from predictive uncertainty or representational geometry. Rather than directly reflecting shared hierarchical computation, neural predictivity may primarily arise from distributed lexical-semantic correspondences that generalize across languages.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: