AIDB Daily Papers
AIの予測精度を高める鍵は「多様性」にある
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- AI予測システムにおいて、限られたサンプル数で精度を最大化するためのモデルアンサンブル手法を調査した。
- 主要なLLMは予測の相関が高く、単にモデルを増やすだけでは精度向上が限定的であることを明らかにした。
- 精度の高さだけでなく、予測の相関が低い多様なモデルを組み合わせることで予測精度が向上することを発見した。
Abstract
Top AI forecasting systems are approaching superforecaster-level accuracy on future world events, but still rely primarily on off-the-shelf LLMs combined with forecasting-specific context gathering and scaffolding. We study how to improve this recipe through ensembling: given a fixed number of samples, which off-the-shelf model forecasts should be combined to maximize accuracy? On binary questions from the Metaculus AI Benchmark, we find that individual accuracy is not enough: many frontier LLMs make highly correlated predictions, limiting the value of additional forecasts from the same or similar models. Instead, the strongest ensembles combine accurate but diverse forecasters, with models such as model{Grok 4} contributing disproportionately because their predictions are less correlated with other frontier LLMs. These results suggest that the strength of the AI crowd comes not from sampling more forecasts indiscriminately, but from combining forecasts across models with complementary errors, motivating forecasting systems that explicitly optimize for both model quality and diversity.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: