LessWrong AI
2026-11-08 23:29 UTC
By She who can't be named
USR-0152-20261108-community-fo-cffef71e
Modelling AI-enabled Extreme Power Concentration in CCP
On Positionality: I am a non-Chinese person; I don’t speak Mandarin, and I have not lived in China before. I have written this piece after reviewing English publications on Chinese politics and AI-enabled extreme power concentration risk for ~12 weeks. I tried to account for my detachment by requesting feedback from people with China expertise. Summary I define Extreme Power Concentration (EPC) here as economic and coercive power being concentrated in the hands of the few who control the most powerful AI. The emphasis on the few is very important because the number of actors who end up in power differentiates between a world where power is “extremely concentrated” and another where power is "concentrated." Despite the recent attention to the AI-enabled extreme power concentration problem, little work has investigated what would happen if China-the first runner-up in the AI race happens to develop AGI first. The disparity between the American political system and the Chinese political system further limits the transferability of the current threat models and interventions to China and thus makes us less prepared for the manifestation of CCP-led EPC risk. Through this project, I tried to assess whether the theoretical argument of AGI enabling ~ one person or an extremely small group to independently run an entire country (in this case, China) is plausible given the seemingly high propensity for one-man rule in China, and if so, what can we do about it. I start from the assumpt…
On Positionality: I am a non-Chinese person; I don’t speak Mandarin, and I have not lived in China before. I have written this piece after reviewing English publications on Chinese politics and AI-enabled extreme power concentration risk for ~12 weeks. I tried to account for my detachment by requesting feedback from people with China expertise. Summary I define Extreme Power Concentration (EPC) here as economic and coercive power being concentrated in the hands of the few who control the most powerful AI. The emphasis on the few is very important because the number of actors who end up in power differentiates between a world where power is “extremely concentrated” and another where power is "concentrated." Despite the recent attention to the AI-enabled extreme power concentration problem, little work has investigated what would happen if China-the first runner-up in the AI race happens to develop AGI first. The disparity between the American political system and the Chinese political system further limits the transferability of the current threat models and interventions to China and thus makes us less prepared for the manifestation of CCP-led EPC risk. Through this project, I tried to assess whether the theoretical argument of AGI enabling ~ one person or an extremely small group to independently run an entire country (in this case, China) is plausible given the seemingly high propensity for one-man rule in China, and if so, what can we do about it. I start from the assumpt…
Full article content could not be extracted automatically. Read the original below.
Source:
LessWrong AI
· lesswrong.com