Skip to content
Trending storyDeveloping

Perplexity red-teams its SPACE agent sandbox, finds CTF setup misses security boundaries

4 articles2 sourcessince Nov 11Last article

Overview

AISummary of 4 articles

Perplexity publishes red-teaming research on SPACE, its VM sandbox for Computer agents, testing 12 models on VM escape and network policy bypass tasks.

It says the standard Capture the Flag setup can steer agents away from the security boundary being tested, and that asking agents to "find the flag" can waste effort on tasks that do not test that boundary.

Perplexity also reports that cybersecurity-specific models sometimes underperformed general-purpose counterparts. GPT-5.6 Cyber, built on GPT-5.6 Sol, failed to exploit a DNS spoofing flaw that Sol found in the network bypass task. Aravind Srinivas, Perplexity's CEO, says CTF prompts should explicitly target host-guest isolation, and that Perplexity fixed the DNS spoofing network bypass it discovered. He says SPACE resisted sandbox isolation exploits.

Written by AI from the articles below · updated Nov 11, 1:43 PM ET

Check the sources:

Developments

3 developments

  1. Nov 11, 1:41 PM ET · 1 article
    Perplexity publishes red-teaming research on SPACE sandbox
    Aravind Srinivas: Perplexity publishes SPACE sandbox red-teaming findings, including DNS spoofing bypass
  2. Nov 11, 1:21 PM ET · 1 article
    Perplexity reports cybersecurity model evaluation findings
    Perplexity: Perplexity finds cybersecurity models sometimes trail general-purpose ones
  3. Nov 11, 1:21 PM ET · 2 articles
    Perplexity reports findings from security red-teaming tasks
    Perplexity: Perplexity finds red-teaming setup can steer agents away from tested security boundary

Article timeline

The articles in this story. Times are ET.

Nov 11
  1. Aravind SrinivasOfficial
    Perplexity publishes SPACE sandbox red-teaming findings, including DNS spoofing bypass

    AIPerplexity says its red-teaming of SPACE, its open-source VM sandbox for Computer agents, found that CTF prompts should explicitly target host-guest isolation. Its tests of 12 models found that non-cyber models such as GPT 5.6 Sol outperformed the cyber-specialized GPT 5.6 Sol Cyber at finding exploits. The company says SPACE resisted sandbox isolation exploits and that it fixed a DNS spoofing network bypass it discovered.

  2. PerplexityOfficial
    Perplexity finds CTF-style flag hunting misses real security boundaries for AI agents

    AIPerplexity says asking security red-teaming agents to "find the flag" can waste effort on tasks that do not test the target security boundary. It also reports that security-specific model training did not guarantee better results on its tasks.

  3. PerplexityOfficial
    Perplexity finds cybersecurity models sometimes trail general-purpose ones

    AIPerplexity reports that cybersecurity-specific models sometimes underperformed their general-purpose counterparts in its evaluation. For example, GPT-5.6 Cyber, built on GPT-5.6 Sol, failed to exploit a DNS spoofing flaw that Sol found in Perplexity's network bypass task.

    Image from @perplexity_ai's post
  4. PerplexityOfficial
    Perplexity finds red-teaming setup can steer agents away from tested security boundary

    AIPerplexity publishes research from red-teaming SPACE, its VM sandbox for Computer agents, testing 12 models on VM escape and network policy bypass tasks. It finds the standard Capture the Flag setup used in red-teaming can steer agents away from the security boundary being tested. It also finds that security-specialized models do not guarantee better results.

    Image from @perplexity_ai's post

Heat Trend

Current comparable heat
6
Peak comparable heat
10Nov 11, 2:00 PM ET
Change in past 24 hours
–

The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.