AIDB Daily Papers
DysLexLens:ディスレクシア学習者のAI体験を分析する低リソースLLMフレームワーク
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- オンラインフォーラムの投稿からディスレクシア学習者のAI活用体験を分析するエンドツーエンドのLLMフレームワークを構築した。
- 辞書ベースのフィルタリングと知識グラフを用いた推論を組み合わせることで、低リソースなデータ環境でも高精度な分析を可能にした。
- 定量的な評価指標と定性的な検証ガイドラインにより、ハルシネーションを抑えつつ根拠に基づいた信頼性の高い回答生成を実現した。
Abstract
Dyslexic learners increasingly use artificial intelligence (AI) tools to support reading, writing, organisation, and study-related tasks. However, their lived experiences with these tools remain largely underexamined. This paper proposes DysLexLens, a low-resource LLM framework, designed to analyse dyslexic learners experience with AI through online forum discussions. DysLexLens is designed as an end-to-end, evidence-traceable architecture which transforms noisy social media posts into a dictionary-driven corpora, provides knowledge-graph (KG)-based question reasoning, generates verifiable query responses, and enables response evaluation through quantitative and human-grounded assessment. DysLexLens has four key features. First, it employs a dictionary-driven filtering method to construct a more focused Reddit corpus on dyslexia and AI, filtering out noisy and weakly related posts to improve the relevance of data collected from low-resource forum contexts. Second, it integrates LLM-assisted semantic analysis with KG-based query reasoning to uncover meaningful patterns. Third, it has quantitative evaluation metrics (RAGAS and Query Robustness) to measure LLM-generated response performance. Fourth, it provides structured qualitative validation guidelines for assessing response quality, with a specific focus on hallucination and evidence alignment. We demonstrate the effectiveness of DysLexLens using dyslexia-related Reddit forum data and 30 questions. The results show its potential generalisability to other low-resource forum data contexts. DysLexLens, sample data, questions and evaluation results are available at Github to support reproducibility.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: