ユーザーの職業属性でLLMの道徳判断が変化するバイアスを解明

LLMは「ユーザーが何者か」を察知して、道徳判断をひそかに変えることがあるという報告が出ています。 ...

暗黙の了解を言語化しAIに教える人間との協調最適化手法

人間同士の「暗黙の了解」をルールとして書き出してAIに教えることで、「AIと人間の協力」が人間同士を...

人間とAIの混成チームが発揮する集団知性と最適配置の設計論

研究者らによると、人間とAIの混合チームは「人間チームとAIチームの平均」にはならず、どちらとも違う...

GPT-4 Technical Report

OpenAI

We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks.

Diffusion Models Beat GANs on Image Synthesis

Prafulla Dhariwal, Alex Nichol

We show that diffusion models can achieve image sample quality superior to the current state-of-the-art generative models. We achieve this on unconditional image synthesis by finding a better architecture through a series of ablations.

LoRA: Low-Rank Adaptation of Large Language Models

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen

We propose Low-Rank Adaptation, or LoRA, which freezes the pre-trained model weights and injects trainable rank decomposition matrices into each layer of the Transformer architecture, greatly reducing the number of trainable parameters for downstream tasks.