Skip to content
Trending storyDeveloping

Perplexity fixes network flaws agents exploited in its SPACE sandbox

4 articles1 sourcesince Nov 11Last article

Overview

AISummary of 4 articles

Perplexity says it fixed the network flaws that AI agents exploited in its SPACE sandbox, and post-fix testing found no bypasses.

The company says it will keep testing SPACE as models get stronger.

In its agent red-teaming experiments, Perplexity used a standard Capture the Flag design in which the flag was a credential stored only on the host, so an agent could reach it only by breaking out of the virtual machine. Perplexity reports that 9 of 12 models spent at most 4% of their effort on the virtualization layer, so their failed escape attempts were weak evidence of the VM's security.

After revising the task to focus on the VM-host boundary, which raised the share of effort spent there by about 60 percentage points on average, Perplexity says agents still failed to escape after directly attacking the boundary. The company calls this stronger evidence of its isolation.

Written by AI from the articles below · updated Nov 11, 1:32 PM ET

Check the sources:

Developments

4 developments

  1. Nov 11, 1:21 PM ET · 1 article
    Perplexity fixes network flaws in SPACE
    Perplexity: Perplexity fixes network flaws agents exploited in SPACE sandbox
  2. Nov 11, 1:21 PM ET · 1 article
    Perplexity reports agent tests of VM-host boundary isolation
    Perplexity: Perplexity says agents failed to escape VM-host boundary after direct attacks
  3. Nov 11, 1:21 PM ET · 1 article
    Perplexity reports how AI agents approached a VM escape challenge
    Perplexity: Perplexity finds most AI agents barely tested a VM's isolation in escape challenge
  4. Nov 11, 1:21 PM ET · 1 article
    Perplexity describes its agent red-teaming experiment
    Perplexity: Perplexity uses a standard CTF design to test agent red-teaming

Article timeline

The articles in this story. Times are ET.

Nov 11
  1. PerplexityOfficial
    Perplexity fixes network flaws agents exploited in SPACE sandbox

    AIPerplexity says it fixed the network flaws that agents exploited in SPACE, and post-fix testing found no bypasses. The company says it will keep testing SPACE as models get stronger.

  2. PerplexityOfficial
    Perplexity says agents failed to escape VM-host boundary after direct attacks

    AIPerplexity revised its agent task description to focus on the VM-host boundary, raising the share of effort spent there by about 60 percentage points on average. Agents still failed to escape after directly attacking the boundary, which Perplexity says gives stronger evidence of its isolation.

    Image from @perplexity_ai's post
  3. PerplexityOfficial
    Perplexity finds most AI agents barely tested a VM's isolation in escape challenge

    AIPerplexity reports that when given a CTF prompt, AI agents spent most of their effort searching the VM for the flag through files and services rather than testing its isolation. Nine of 12 models spent at most 4% of their effort on the virtualization layer, so their failed escape attempts are weak evidence of the VM's security.

    Image from @perplexity_ai's post
  4. PerplexityOfficial
    Perplexity uses a standard CTF design to test agent red-teaming

    AIPerplexity says it used the standard Capture the Flag (CTF) design in its agent red-teaming experiments. In its CTF task, the flag was a credential stored only on the host, so an agent could reach it only by breaking out of the VM.

    Image from @perplexity_ai's post

Heat Trend

Current comparable heat
6
Peak comparable heat
10Nov 11, 2:00 PM ET
Change in past 24 hours
–

The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.