Skip to content
View original post on X: Ai2Official
Published
23/100

StateBench splits state tracking into four difficulty levels

AIAi2 introduces StateBench, which divides state tracking into four levels: r-trivial, aperiodic, soluble, and general finite. The levels range from simple tasks such as remembering a fixed fact like a birth date to harder ones such as tracking a ball as cups are repeatedly swapped.
Ai2Verified on XOfficial
@allen_ai
View on X

Part of a thread · earlier post

StateBench separates state tracking into 4 levels: r-trivial, aperiodic, soluble, & general finite.

These range from problems like remembering something fixed, such as a birth date, to harder ones like tracking a ball as cups are repeatedly swapped.

Source details

Ai2 · x.comPublished · added here

Original title: StateBench separates state tracking into 4 levels: r-trivial, aperiodic, soluble, & general finite.