LessWrong AI
2026-10-08 20:47 UTC
By KatjaGrace
USR-0152-20261008-community-fo-91190f6c
When will AI surpass us at being limited?
It’s not always better to be more capable. As I mentioned yesterday , it can ( famously ) be helpful in negotiations to have your hands tied. That is, to be disempowered from giving up everything the other party wants. I had previously thought of this as a somewhat rare corner case of human behavior—I for one don’t haggle very often—but I now think negotiations where this is an element are are quite common: yesterday I described it in friendly (and honest) negotiations about how to spend time, for instance. And I also see a related thing in the practice of dietary commitments. But is being less capable helpful outside of negotiating? And is this going to become AI related? Yes and yes! Commitments: more good things come to those who can commit (e.g. rides out of deserts , secrets, trust, love). ‘Committing’ generally involves cutting off certain options to yourself, whether in practical terms or via you being the kind of honorable person who can’t bear to do a thing they promised not to do. These are both kinds of limitations. If you were a more powerful creature, who was fully capable of breaking down any barrier, and fully capable of breaking a promise—a creature to whom all options were always open—then commitments would be less available to you. Transparency: a big way humans know what is going on inside other humans, well enough to trust them, is that there is a connection between what is happening inside them and what is happening on their faces and in their bodies, an…
It’s not always better to be more capable. As I mentioned yesterday , it can ( famously ) be helpful in negotiations to have your hands tied. That is, to be disempowered from giving up everything the other party wants. I had previously thought of this as a somewhat rare corner case of human behavior—I for one don’t haggle very often—but I now think negotiations where this is an element are are quite common: yesterday I described it in friendly (and honest) negotiations about how to spend time, for instance. And I also see a related thing in the practice of dietary commitments. But is being less capable helpful outside of negotiating? And is this going to become AI related? Yes and yes! Commitments: more good things come to those who can commit (e.g. rides out of deserts , secrets, trust, love). ‘Committing’ generally involves cutting off certain options to yourself, whether in practical terms or via you being the kind of honorable person who can’t bear to do a thing they promised not to do. These are both kinds of limitations. If you were a more powerful creature, who was fully capable of breaking down any barrier, and fully capable of breaking a promise—a creature to whom all options were always open—then commitments would be less available to you. Transparency: a big way humans know what is going on inside other humans, well enough to trust them, is that there is a connection between what is happening inside them and what is happening on their faces and in their bodies, an…
Full article content could not be extracted automatically. Read the original below.
Source:
LessWrong AI
· lesswrong.com