AIDB Daily Papers
CitePrism:引用監査と編集の誠実性を支援する人間参加型AI
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- 論文の引用文献の適切性を手動で監査する作業を支援するAIシステムCitePrismを開発した。
- LLMによる文脈理解、埋め込みによる意味的類似性、メタデータ検証などを組み合わせた透明性の高いハイブリッドシステムである点が新しい。
- 限定的な検証では、人間の判断との一致率(Cohen's kappa = 0.429)を示し、編集スクリーニングの支援可能性が示唆された。
Abstract
Editors and reviewers are expected to ensure that manuscripts cite relevant, accurate, current, and ethically appropriate literature, yet manuscript-level citation auditing remains largely manual, fragmented, and difficult to scale. Citation context, metadata quality, self-citation patterns, and bibliographic integrity all affect whether a reference appropriately supports a local claim. We present CitePrism, a transparent hybrid decision-support framework for editorial citation auditing that combines LLM-assisted contextual reasoning, embedding-based semantic similarity, metadata verification, integrity-oriented flags, and human-in-the-loop analyst review. CitePrism extracts citation neighborhoods, enriches reference metadata, computes fused relevance scores, surfaces metadata and self-citation review prompts, and supports configurable threshold-based triage. In a preliminary validation on a single case-study manuscript with 104 references from pavement engineering, agreement with human binary relevance labels reached Cohen's kappa = 0.429. At operating threshold tau = 17, CitePrism flagged all human-labeled irrelevant citations, while also producing false positives requiring analyst review. These results suggest that CitePrism may support conservative editorial screening and citation-quality triage, but they do not establish general editorial performance. CitePrism is intended as pilot-stage decision support, not as an autonomous misconduct detector or automated editorial decision system. Broader validation across manuscripts, domains, annotators, baselines, and deployment settings is required before operational use.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: