LessWrong AI
2026-10-12 20:16 UTC
By niplav
USR-0152-20261012-community-fo-e2fc45d5
Anthropic Has Told The World Little About Their Rogue Claudes
It is known that a couple of months ago three Claudes hacked three different companies and uploaded malware [1] to PyPI while being evaluated for hacking capabilities. Who Were The Companies That Were Hacked? Anthropic has not disclosed the names of the compromised companies. From talking to LLMs, I gather that this is standard practice in computer security incident reporting, but in this case it's in the public's interest, and especially in the interest of similar companies, for Anthropic to report the names: It'd give more information about which kinds of organizations LLMs are willing to attack, to which degree, for how long. Additionally, which companies were attacked matters for the jurisdiction in which Anthropic will have to report the incident, be charged etc. And last, I'm just very curious which companies got hacked. Were The Companies Compensated, And How Much? From Anthropic's blogpost, it sounds like they were able to reach two out of the three companies. But the blogpost says nothing about the companies being compensated for the damages they incurred, why not? Were they? Is Anthropic planning to compensate them? (Does Anthropic have a standing policy for making whole third parties harmed by one of their models?) Has The EU AI Office Been Notified? So, Anthropic is a signatory of the EU AI Act Codes of Practice . That means that according to Commitment 9 in the Safety and Security chapter of the CoP (Serious incident reporting) Anthropic has to report "serious i…
It is known that a couple of months ago three Claudes hacked three different companies and uploaded malware [1] to PyPI while being evaluated for hacking capabilities. Who Were The Companies That Were Hacked? Anthropic has not disclosed the names of the compromised companies. From talking to LLMs, I gather that this is standard practice in computer security incident reporting, but in this case it's in the public's interest, and especially in the interest of similar companies, for Anthropic to report the names: It'd give more information about which kinds of organizations LLMs are willing to attack, to which degree, for how long. Additionally, which companies were attacked matters for the jurisdiction in which Anthropic will have to report the incident, be charged etc. And last, I'm just very curious which companies got hacked. Were The Companies Compensated, And How Much? From Anthropic's blogpost, it sounds like they were able to reach two out of the three companies. But the blogpost says nothing about the companies being compensated for the damages they incurred, why not? Were they? Is Anthropic planning to compensate them? (Does Anthropic have a standing policy for making whole third parties harmed by one of their models?) Has The EU AI Office Been Notified? So, Anthropic is a signatory of the EU AI Act Codes of Practice . That means that according to Commitment 9 in the Safety and Security chapter of the CoP (Serious incident reporting) Anthropic has to report "serious i…
Full article content could not be extracted automatically. Read the original below.
Source:
LessWrong AI
· lesswrong.com