The open-source RISE red-teaming algorithm from White Circle learns to write better attack prompts against image models. It runs on an open Qwen model with Gemini Flash as the judge, so defenders can run the same tests on their own image models.
What AI Safety needs is better tooling and engineering.
For instance, building stronger red-teaming tools.
Great to see this open-source effort to red-team image models. It seems to learn better ways to write attack prompts.
It is open source and runs on an open Qwen model with Gemini Flash as the judge, so defenders can run the same tests on their own image models.
We are open-sourcing RISE, our red-teaming algorithm that breaks the safeguards of the latest image models from OpenAI, DeepMind, and others. RISE uses readily available models like Qwen and Gemini Flash under the hood, with no additional training required. Read more: https://whitecircle.com/research/breaking-frontier-image-models
Source: elvis · x.comPublished · added here
