We developed the Iris Safety Evaluations (ISE) to test whether Beam’s responses align with and uphold our safety policy in realistic contexts, such as in adversarial and agentic settings. Evaluated across cyber offense, chemical, biological, and radiological/nuclear categories, Beam holds higher refusal rates than leading Western and Chinese open models.
Reflection introduces Iris Safety Evaluations to test Beam's safety policy adherence
AIReflection developed the Iris Safety Evaluations (ISE) to test whether Beam's responses align with its safety policy in adversarial and agentic settings. Across cyber offense, chemical, biological, and radiological/nuclear categories, Beam has higher refusal rates than leading Western and Chinese open models, according to the company.
Source details
Reflection · x.comPublished · added here
Original title: We developed the Iris Safety Evaluations (ISE) to test whether Beam’s responses align with and uphold our safety policy in realistic cont...