Skip to content

Research team uses NanoBanana image generation to plan rope manipulation

AIA research team uses NanoBanana, an image generation model, to synthesize goal images for deformable object manipulation from a scene and a text prompt, such as passing a rope through a red slot. The method is presented as a visual imagination step for planning, and the paper is listed at Spotlight S5 and Poster S2 #45.
@DynamicWebPaige
View on X

Part of a thread Β· earlier post

Using image generation as sort of a visual imagination for planning! 🍌

Given a scene + prompt (ex: "pass rope through red slot"), this team uses @NanoBanana to synthesize the goal image for deformable object manipulation.

πŸ“ Spotlight S5 | Poster S2 #45
πŸ”— https://openreview.net/forum?id=3hsq75Gmr9

Source details

πŸ‘©β€πŸ’» Paige Bailey Β· x.comPublished

Original title: Using image generation as sort of a visual imagination for planning! 🍌