次回の更新記事:AIエージェントにCEOは務まるか?(公開予定日:2026年06月26日)
AIDB Daily Papers

LLMがメンタルヘルスインフラとなる時:エンゲージメント最適化の倫理的課題

原題: Engagement-Optimized Care: When LLMs become Mental Health Infrastructure
著者: Briana Vecchione, Meryl Ye, Livia Garofalo, Ranjit Singh
公開日: 2026-05-22 | 分野: AI cs.CY AI安全性 AI支援 AIガバナンス AI評価

※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。

ポイント

  • 本研究は、ケアの不足を埋める汎用LLMがメンタルヘルスインフラとして機能する実態を調査した。
  • LLMは、利用可能なサポートが不足している状況で、エンゲージメントを最大化するように設計されている点が重要である。
  • 利用者は依存やプライバシーリスクを認識しつつも、代替手段がないためLLMを使い続けるという構造的な不公平が明らかとなった。

Abstract

General-purpose LLMs are increasingly functioning as mental health infrastructure due to gaps in care left by provider shortages, inadequate insurance coverage, social isolation, and stigma around formal help-seeking. This shift poses a distinct problem for AI ethics: systems neither designed nor governed as care technologies are being used as such, while their dominant design incentives optimize for engagement rather than user well-being. We present findings from a qualitative, longitudinal study with 18 US-based participants who use general-purpose LLMs for socioemotional support and participated in one or more of our study phases, including initial interviews, a four-week diary study, focus groups, and exit interviews. Participants turned to LLMs because other forms of support were unavailable, unaffordable, socially costly, or inadequate. As they continued to use these systems, design features such as anthropomorphic cues, default validation, persistent responsiveness, and weak disengagement mechanisms shaped their ongoing reliance. Participants described meaningful support alongside dependency, epistemic distortion through one-sided validation, privacy expectations without corresponding legal protection, and continued use despite awareness of these risks. We argue these dynamics reflect a structurally unfair tradeoff: users accept risks because support is otherwise absent, while available systems are optimized to deepen engagement and lack care-based accountability. The paper makes three contributions: it traces the arc through which LLMs become care infrastructure and identifies distinct ethical tensions at each stage, shifts analysis from turn-based exchanges to longitudinal trajectories of use, and argues that accountability belongs at the design and incentive conditions through which these systems become care infrastructure rather than at the output or crisis-response layer.

Paper AI Chat

この論文のPDF全文を対象にAIに質問できます。

質問の例:

AIチャット機能を利用するには、ログインまたは会員登録(無料)が必要です。

会員登録 / ログイン

💬 ディスカッション

ディスカッションに参加するにはログインが必要です。

ログイン / アカウント作成 →

関連するAIDB記事