AIDB Daily Papers
ログ内容を悪用するプロンプトインジェクション:LLM搭載のセキュリティ運用を狙う攻撃
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- ログデータに悪意のある指示を埋め込む「ログ基質プロンプトインジェクション」という新たな攻撃手法を提案した。
- この攻撃は、特にインシデントの要約タスクにおいて高い成功率を示し、セキュリティ運用におけるLLMの脆弱性を浮き彫りにした。
- 防御策は攻撃効果を低減させるものの、完全には排除できず、ログ内容を敵対的な入力として扱う必要があることが示された。
Abstract
Large language models (LLMs) are increasingly used as analyst assistants in security operations centers (SOCs), where they ingest log and alert data to produce triage labels, incident summaries, or remediation advice. We study a structural failure mode of this design: many log fields are attacker controlled. User agents, URLs, payloads, DNS queries, and attempted usernames can therefore carry instructions to the model alongside evidence of the intrusion. We call this setting emph{log-substrate prompt injection}. We introduce a four-class taxonomy of log-substrate attacks: direct override (S1), persona hijack (S2), context manipulation (S3), and obfuscated payloads (S4). We evaluate 48 strategy-defense-task combinations using texttt{gpt-4o-mini} as the analyst. Three findings stand out. First, direct overrides are ineffective in our setting: all S1 classification attacks achieve 0% suppression. In contrast, persona hijacks suppress 68% of malicious logs under a naive classifier and remain effective under stronger defenses. Second, summarization is the highest-risk task: context manipulation reaches 96% injection success without defenses and 38% even with constrained output. Third, defenses reduce but do not eliminate the attack surface: average injection success falls from 26.6% under naive prompting to 11.8% under our strongest defense. We also compare empirical results to a deterministic mock analyst and find that simulation substantially mispredicts current model behavior, especially for direct overrides. These results suggest that SOC copilots should treat raw log content as adversarial input rather than ordinary analyst context.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: