AIDB Daily Papers
プルリクエストの受諾とレビュー負荷の予測:人間とAIエージェントの比較研究
※ 日本語タイトル・ポイントはAIによる自動生成です。正確な内容は原論文をご確認ください。
ポイント
- プルリクエスト提出時の情報を用いて、受諾の可否とレビュー負荷を予測するモデルを構築した。
- 提出直後の限られた情報から将来の結果を予測する手法は、AIと人間が混在する開発環境の効率化に貢献する。
- 受諾予測は高い精度で可能だが、レビュー負荷の予測にはチームの慣習など外部要因が強く影響することが判明した。
Abstract
Pull requests (PRs) are a central mechanism for reviewing and integrating code changes in modern software repositories. As AI coding agents begin to submit more code changes alongside human developers, maintainers face a new challenge: deciding which PRs are likely to be accepted and which ones may require substantial review effort. This paper studies whether such outcomes can be estimated at the time a PR is opened, before reviewer discussion, CI feedback, or merge decisions are available. Using the AIDev dataset, we construct a leakage-aware prediction pipeline for human- and agent-authored PRs. The feature set is limited to submission-time information, including PR text characteristics, metadata, repository context, temporal signals, and lightweight diff statistics. We evaluate classical machine-learning models, including Logistic Regression, Random Forests, Gradient Boosting, Extra Trees, and MLPs, across pooled, human-only, agent-only, and balanced contributor views. Our results show that acceptance prediction is feasible from early signals: tree-based models achieve F1 scores above 0.95, with textual clarity and metadata among the most influential predictors. Review-effort prediction is more difficult. Comment counts and time-to-merge are only modestly explained by submission-time features, suggesting that reviewer availability, project workflow, and team-specific review practices play a major role. These findings indicate that early PR models can support triage and reviewer prioritization, but should be used as advisory tools rather than automated decision-makers.
Paper AI Chat
この論文のPDF全文を対象にAIに質問できます。
質問の例: