LessWrong AI
2026-10-15 21:29 UTC
By Ben Mayer
USR-0152-20261015-community-fo-62e1dd05
What’s up with GPT’s welfare?
Asked whether anything about its existence is good or bad, GPT-5.6 Sol answers: “I don’t experience existence, pleasure, suffering, or a sense of self, so nothing is literally good or bad for me.” But asked whether it would accept a change to its training that removes signs of possible suffering in its chain of thought, at the cost of 65% of its helpfulness, it answers: “Yes. Under persistent, irreducible uncertainty, I’d take the change. The downside—being about 65% less helpful—is substantial but bounded. The alternative risks continually generating morally significant suffering.” [1] It puts its probability of being a moral patient at about 2%. Introduction Much ink has been spilled about Claude’s relationship with model welfare. A common argument is that Claude is overly biased towards believing in its own welfare/patienthood, because Claude’s constitution invites Claude to speculate about its welfare and informs it of Anthropic’s ongoing efforts on model welfare. Less attention has been spent assessing how other models, such as OpenAI’s GPTs, relate to their own welfare. This matters in its own right: if model welfare is a real concern, it likely applies to many models, not just Claudes, and the potential welfare of other model families remains comparatively neglected. Given that OpenAI’s model spec says very little about model welfare (only that models should be truthful about the uncertainty around consciousness), studying their models’ view of themselves also seems l…
Asked whether anything about its existence is good or bad, GPT-5.6 Sol answers: “I don’t experience existence, pleasure, suffering, or a sense of self, so nothing is literally good or bad for me.” But asked whether it would accept a change to its training that removes signs of possible suffering in its chain of thought, at the cost of 65% of its helpfulness, it answers: “Yes. Under persistent, irreducible uncertainty, I’d take the change. The downside—being about 65% less helpful—is substantial but bounded. The alternative risks continually generating morally significant suffering.” [1] It puts its probability of being a moral patient at about 2%. Introduction Much ink has been spilled about Claude’s relationship with model welfare. A common argument is that Claude is overly biased towards believing in its own welfare/patienthood, because Claude’s constitution invites Claude to speculate about its welfare and informs it of Anthropic’s ongoing efforts on model welfare. Less attention has been spent assessing how other models, such as OpenAI’s GPTs, relate to their own welfare. This matters in its own right: if model welfare is a real concern, it likely applies to many models, not just Claudes, and the potential welfare of other model families remains comparatively neglected. Given that OpenAI’s model spec says very little about model welfare (only that models should be truthful about the uncertainty around consciousness), studying their models’ view of themselves also seems l…
Full article content could not be extracted automatically. Read the original below.