Google Research introduces Agile Deliberation for defining subjective AI classifiers

Google Research introduces Agile Deliberation, a framework that turns the creation of subjective AI classifiers into an iterative conversation between users and a vision-language model.

The system helps users break a concept into sub-concepts and exclusions, then surfaces borderline images to refine those definitions.

In 18 live 1.5-hour sessions, participants produced more consistent classifiers that outperformed standard baselines and reported less fatigue, according to Google Research's full report. The company's X post says the framework reduces user fatigue and improves classifier accuracy in gray-area tasks such as content moderation and curating art. The code and algorithms are open-sourced on GitHub.