AIDB Daily Papers
Revise:データ汚染戦略を用いた実践的情報システムにおけるOCRテキスト修正フレームワーク
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- OCRで生じる文字、単語、構造レベルのエラーを体系的に修正するフレームワークReviseを提案。
- 一般的なOCRエラーの階層的分類と、それを模倣する合成データ生成戦略で効果的な修正モデルを訓練。
- ReviseはOCR出力を効果的に修正し、文書検索や質問応答の性能を大幅に向上させることが示された。
Abstract
Recent advances in Large Language Models (LLMs) have significantly improved the field of Document AI, demonstrating remarkable performance on document understanding tasks such as question answering. However, existing approaches primarily focus on solving specific tasks, lacking the capability to structurally organize and manage document information. To address this limitation, we propose Revise, a framework that systematically corrects errors introduced by OCR at the character, word, and structural levels. Specifically, Revise employs a comprehensive hierarchical taxonomy of common OCR errors and a synthetic data generation strategy that realistically simulates such errors to train an effective correction model. Experimental results demonstrate that Revise effectively corrects OCR outputs, enabling more structured representation and systematic management of document contents. Consequently, our method significantly enhances downstream performance in document retrieval and question answering tasks, highlighting the potential to overcome the structural management limitations of existing Document AI frameworks.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: