AIDB Daily Papers
GitHubリポジトリにおけるAI利用の特徴と進化に関する実証研究:コードコメントからの洞察
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- GitHubのコードコメントを分析し、開発者がAIツールをどのように利用しているかを調査した。
- AIツールの利用はコード実装が中心だが、時間と共に知識・概念支援や機能拡張へと変化している。
- AI支援コードはリファクタリングやバグ修正を経て、人間による継続的な監視下で進化していることが示された。
Abstract
Developers increasingly use AI tools such as ChatGPT, Copilot, and Claude in everyday software workflows, but prior studies often evaluate LLM outputs in isolation rather than examining how developers adapt them in real projects. We analyze 35,361 GitHub code comments that explicitly reference AI use and their associated code blocks. We first open-code 500 unique comments and code blocks to derive a taxonomy of AI-assisted development activities, then annotate the full dataset using two LLM-based classifiers and aggregate predictions with Dawid-Skene expectation-maximization. We also analyze 12,996 subsequent commit messages to study how AI-assisted code evolves after introduction, and examine temporal trends from December 2022 to March 2026. Our results show that developers primarily use LLMs for code implementation, followed by code enhancement, debugging, documentation, and testing. Subsequent commits frequently involve refactoring and cleanup, feature integration and extension, and bug fixing, indicating sustained human oversight in adapting AI-assisted code. Over time, AI-referencing comments shift from direct code generation toward knowledge and conceptual support and code enhancement. These findings suggest that AI tools are becoming embedded not only as code-generation aids, but also as collaborative support mechanisms whose outputs are refined, extended, and corrected by developers over time.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: