Agile Deliberation: How AI helps humans define the gray areas

Google Research introduces Agile Deliberation, a framework that treats building subjective AI classifiers as an iterative conversation, splitting the task into concept scoping (breaking a broad idea into sub-concepts and exclusions) and concept iteration (using vision-language models to surface borderline images that challenge the user's definitions). In 18 live 1.5-hour user sessions across the subjective domains of "Healthy Food" and "Pay-to-Play" content moderation, the approach produced more consistent, higher-performing classifiers than zero-shot, automated collaborator, and manual deliberation baselines while reducing user fatigue and anxiety. The code and algorithms are open-sourced on GitHub, with a Colab/Jupyter demo available.