AIDB Daily Papers
MERaLiON2-Omni:東南アジア向けマルチモーダル大規模言語モデルによる認知能力の解放と知覚-論理のトレードオフ分析
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- 東南アジアに特化した100億パラメータの多言語対応マルチモーダル大規模言語モデル、MERaLiON2-Omni (Alpha)を発表しました。
- 知覚(System 1)と推論(System 2)能力を分離・統合する段階的な学習パイプラインにより、効率的な知識転移と高品質なデータ合成を実現しました。
- SEA-Omniベンチマークで評価した結果、推論は抽象的なタスクの性能を向上させる一方、低レベルの感覚処理に不安定性をもたらすことが明らかになりました。
Abstract
Recent advancements in Multimodal Large Language Models (MLLMs) pursue omni-perception capabilities, yet integrating robust sensory grounding with complex reasoning remains a challenge, particularly for underrepresented regions. In this report, we introduce the research preview of MERaLiON2-Omni (Alpha), a 10B-parameter multilingual omni-perception tailored for Southeast Asia (SEA). We present a progressive training pipeline that explicitly decouples and then integrates "System 1" (Perception) and "System 2" (Reasoning) capabilities. First, we establish a robust Perception Backbone by aligning region-specific audio-visual cues (e.g., Singlish code-switching, local cultural landmarks) with a multilingual LLM through orthogonal modality adaptation. Second, to inject cognitive capabilities without large-scale supervision, we propose a cost-effective Generate-Judge-Refine pipeline. By utilizing a Super-LLM to filter hallucinations and resolve conflicts via a consensus mechanism, we synthesize high-quality silver data that transfers textual Chain-of-Thought reasoning to multimodal scenarios. Comprehensive evaluation on our newly introduced SEA-Omni Benchmark Suite reveals an Efficiency-Stability Paradox: while reasoning acts as a non-linear amplifier for abstract tasks (boosting mathematical and instruction-following performance significantly), it introduces instability in low-level sensory processing. Specifically, we identify Temporal Drift in long-context audio, where extended reasoning desynchronizes the model from acoustic timestamps, and Visual Over-interpretation, where logic overrides pixel-level reality. This report details the architecture, the data-efficient training recipe, and a diagnostic analysis of the trade-offs between robust perception and structured reasoning.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: