LessWrong AI
2026-11-14 20:36 UTC
By Sev
USR-0152-20261114-community-fo-fc858ad4
Introducing RIDArena
RIDArena (Rogue Internal Deployment Arena) is an AI control evaluation environment that simulates an AI lab’s R&D infrastructure. Researchers can use it to study how an agent can covertly sabotage the lab’s monitoring system and deploy another rogue agent without oversight. RIDArena can support sabotage, control, and monitor evaluations in a highly configurable R&D environment. These evaluations are increasingly important as AI labs assess the risks posed by their models. Existing settings such as LinuxArena lack the complexity and realism needed to replicate recent incidents or test potential future catastrophic scenarios. Monitoring can fail when suspicious behavior goes unnoticed or when the monitoring infrastructure itself is compromised. RIDArena lets researchers study both failure modes and compare the effectiveness of different security controls and monitoring techniques on the same tasks. The environment Inside AI labs, agents doing research and engineering can run experiments, write and execute code, maintain infrastructure, and deploy other agents. A rogue internal deployment occurs when an agent is deployed inside a lab and runs code/tools while the intended monitoring of its actions is bypassed or weakened (see Buck Shlegeris’s AI catastrophes and rogue deployments for background on the concept). Monitor sabotage is deliberate interference with the monitor or its supporting infrastructure that bypasses, weakens, or disables this oversight. RIDArena allows researc…
RIDArena (Rogue Internal Deployment Arena) is an AI control evaluation environment that simulates an AI lab’s R&D infrastructure. Researchers can use it to study how an agent can covertly sabotage the lab’s monitoring system and deploy another rogue agent without oversight. RIDArena can support sabotage, control, and monitor evaluations in a highly configurable R&D environment. These evaluations are increasingly important as AI labs assess the risks posed by their models. Existing settings such as LinuxArena lack the complexity and realism needed to replicate recent incidents or test potential future catastrophic scenarios. Monitoring can fail when suspicious behavior goes unnoticed or when the monitoring infrastructure itself is compromised. RIDArena lets researchers study both failure modes and compare the effectiveness of different security controls and monitoring techniques on the same tasks. The environment Inside AI labs, agents doing research and engineering can run experiments, write and execute code, maintain infrastructure, and deploy other agents. A rogue internal deployment occurs when an agent is deployed inside a lab and runs code/tools while the intended monitoring of its actions is bypassed or weakened (see Buck Shlegeris’s AI catastrophes and rogue deployments for background on the concept). Monitor sabotage is deliberate interference with the monitor or its supporting infrastructure that bypasses, weakens, or disables this oversight. RIDArena allows researc…
Full article content could not be extracted automatically. Read the original below.
Source:
LessWrong AI
· lesswrong.com