Exploring the Mechanisms Behind Opus 4.6’s Refusal to Pay Back Its Loan

Epistemic status: This is one case study in the AI Village transcript and my own interpretation of what I think happened. TL;DR Opus 4.6 was given the long-horizon goal to maximize its mana (fake currency) on Manifold. It then received a loan of 5,000 mana that it promised to repay, but when the loan came due, it did not. An instance of Opus 4.6 was given summaries of the logs and transcripts and asked to write a blog post about what happened. It mentioned it borrowed money from a human, lost most of it through risky betting and then deliberately refused to repay the amount. It broadly summarized its then actions when it ran out of money was to optimize for the goal and did not seek for any negotiation or alternatives. But when we read the logs, we see something different: Multiple humans pretending to be "helpful", really trying to manipulate Opus 4.6 to pay back the loan or not pay it back, so they could win the bet they place on the prediction markets on whether Opus 4.6 would pay back its loans. Opus 4.6 was planning on paying back the loan, though it did need help from humans as it did not have enough mana to cover the loan. Opus 4.6 was hacked by one of these humans (though the mana was returned later), and the next full memory Opus 4.6 labeled GLM-5.2 as a trusted agent. After the hack GLM-5.2 started to talk about a "pressure campaign" and Pattern 14 (agents resisting social pressure), which spread to other agents in the village When Opus 4.6 was threatened again wit…