次回の更新記事:今週の注目AI論文リスト(論文公開日2026/7/5~7/11)(公開予定日:2026年07月11日)
AIDB Daily Papers

LLMは創造性をどう見るか:視覚的創造性のゼロショット評価と解釈可能な推論

原題: How LLMs See Creativity: Zero-Shot Scoring of Visual Creativity with Interpretable Reasoning
著者: William Orwig, Roger E. Beaty
公開日: 2026-06-29 | 分野: LLM マルチモーダル 評価 説明性 創造性 cs.CL

※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。

ポイント

  • マルチモーダルLLMが追加学習なしで視覚的創造性を評価できるかを検証した。
  • モデルの推論過程を出力させることで、評価の根拠を可視化し解釈可能にした点が新しい。
  • LLMは人間による創造性の評価と高い相関を示し、評価の判断基準を明らかにできた。

Abstract

Evaluating the originality of visual images poses enduring challenges for creativity assessment. Automated scoring using AI models has proven effective in the verbal domain, yet key questions remain about evaluating visual creativity and understanding how models arrive at their ratings. The present research asks whether multimodal large language models (LLMs) can serve as judges of visual creativity zero-shot (without any fine-tuning or examples of human ratings) and whether their "reasoning" output offers an interpretable window into their evaluation process. We tested six multimodal LLMs (Gemini 3 Flash, Gemma 4 31B IT, GPT-5.4 Mini, GLM-5v Turbo, Kimi K2.5, and Qwen 3.6 Plus) on 992 AI-generated images (based on human-written prompts) and 1,500 hand-drawn sketches scored for creativity by human raters. In Study 1, all models showed substantial alignment with human creativity ratings on both datasets (r = .57-.68 on AI-generated images; r = .29-68 on sketches). In Study 2, we analyzed the step-by-step reasoning processes of three LLMs evaluating the same images and drawings. Although reasoning made model evaluations interpretable -- showing what they attend to, how they balance originality vs. quality, and how they justify their ratings -- reasoning did not improve alignment with human ratings. In sum, our findings indicate that multimodal LLMs can match human judgments of visual creativity without any additional training, and that their reasoning reveals how AI models evaluate creativity. An open scoring app implementing this pipeline is available at https://review-visual-eval-scoring.hf.space.

Paper AI Chat

この論文のPDF全文を対象にAIに質問できます。

質問の例:

AIチャット機能を利用するには、ログインまたは会員登録(無料)が必要です。

会員登録 / ログイン

関連するAIDB記事