My Chinese Internet Is Talking About AI Doom

Summary

This essay examines how discussion of AI catastrophe spread across Chinese online platforms after Jacob Coxon resigned from Anthropic and his warning about AI risk went viral. Coxon had worked on frontier models at OpenAI before joining Anthropic, which made the warning legible to audiences beyond established AI-safety circles. By September 12, a WeChat article about his resignation had more than 100,000 reads, 11,200 shares, and 891 comments. Coverage in Chinese mainstream media framed the issue in several ways: recursive self-improvement could make AI uncontrollable; alignment failures could involve power-seeking or resistance to shutdown; warnings might be fear marketing; and enormous compute and capital could make it difficult for any single lab to stop. The essay also cites Evan Hubinger’s view that AI could cause human extinction within the next decade with a probability above 10%, while noting counterarguments from a senior Pentagon official and Jensen Huang. Chinese technology writers and influencers debated whether AI development is an arrogant gamble being made inside private companies without strong international oversight, and whether training involving civilization-scale risks should require verifiable pause and review mechanisms. Commenters questioned whether Transformer-based systems can surpass humans, whether AI can influence people simply through growing dependence, and whether unmonitored delegation creates more immediate risks than machine “awakening.” Other discussions used nuclear weapons and the Three-Body Problem as analogies, while also asking whether states or powerful institutions could safely govern AI. The author stresses that these voices do not represent what “China thinks,” but argues that the story crossed language and platform boundaries unusually easily because it came from someone who had helped build leading models and then left. The essay concludes by describing plans for private discussions between researchers in the United States and China.