In our initial ToyBlocks tests, ManiFlow, π0.5, & MolmoAct 2 generalized poorly to new spatial configurations.
Controlled experiments let us test changes to training & model design, then measure which techniques improve generalization.
Ai2 finds ManiFlow, π0.5, and MolmoAct 2 generalize poorly in ToyBlocks tests
AIAi2 says ManiFlow, π0.5, and MolmoAct 2 generalized poorly to new spatial configurations in its initial ToyBlocks tests. The company says controlled experiments will test changes to training and model design to measure which techniques improve generalization.
Source details
Ai2 · x.comPublished · added here
Original title: In our initial ToyBlocks tests, ManiFlow, π0.5, & MolmoAct 2 generalized poorly to new spatial configurations.