AIDB Daily Papers
歴史的宇宙論を用いたドメイン適応と推論フレームワークの制御実験
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- 歴史的宇宙論を対象に、ドメイン適応が言語モデルの説明行動をどのように変化させるかを制御実験で調査した。
- 事前学習済みモデルのファインチューニングにより、宇宙論的スタンスは安定したまま、前近代的な説明フレームへの有意なシフトが観察された。
- ドメイン適応は主に言語的フレームワークを再構築し、スタンスの変化は二次的に生じる可能性が示唆された。
Abstract
We investigate how domain adaptation reshapes explanatory behavior in language models using historical cosmology as a controlled setting. In Phase 1, we train a small language model from scratch on a pre-Copernican corpus from which explicit heliocentric references were removed, and evaluate whether Earth-motion or heliocentric continuations nevertheless emerge. In Phase 2, we fine-tune a larger pretrained model using QLoRA on the same corpus in order to study how adaptation modifies explanatory framing and cosmological stance. Model outputs are evaluated using an LLM-as-judge framework that labels both cosmological stance (geocentric, heliocentric, or ambiguous) and explanatory frame (premodern versus modern). In the constrained setting of Phase 1, the smaller models occasionally generate local Earth-motion continuations, but these remain globally unstable and insufficient to support coherent cosmological reasoning. In Phase 2, fine-tuning induces a large and statistically significant shift toward premodern explanatory framing, while the conditional cosmological stance distributions remain comparatively stable within those frames. As a result, increases in geocentric outputs arise primarily from redistribution over explanatory regimes rather than from direct modification of stance. These results suggest that domain adaptation may primarily reshape the linguistic frameworks from which continuations are generated, with changes in stance emerging secondarily from those shifts.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: