Must-read paper on scaling multi-agent swarms.
The main focus right now is training agent swarms to coordinate and cooperate better. Here is a promising new work on this.
The problem:
Multi-agent systems usually follow a plan that a developer writes ahead of time.
The plan decides which agent does what and when agents message each other, and it usually stays the same across tasks.
What they propose:
s3 has the agents learn that plan instead. Agents learn through cooperative RL when to work alone, when to share findings, and when to read teammates' work. There are no predefined roles.
With matched training and inference budgets, s3 swarms tested at twice their training size solve over 25x more coordination problems than the strongest baseline. In parallel exploration, communicating agents repeat nearly 50% less work and beat best-of-N by up to 9.4 points.
The agents develop complementary roles on their own, and those roles carry over to bigger teams.
https://arxiv.org/abs/2611.08615
Chat with Paper: https://academy.dair.ai/papers/s-3-simple-scaling-of-swarms-via-cooperative-multi-agent-rl-2611.08615