site banner

Culture War Roundup for the week of April 21, 2025

This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.

Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.

We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:

  • Shaming.

  • Attempting to 'build consensus' or enforce ideological conformity.

  • Making sweeping generalizations to vilify a group you dislike.

  • Recruiting for a cause.

  • Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.

In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:

  • Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.

  • Be as precise and charitable as you can. Don't paraphrase unflatteringly.

  • Don't imply that someone said something they did not say, even if you think it follows from what they said.

  • Write like everyone is reading and you want them to be included in the discussion.

On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.

5
Jump in the discussion.

No email address required.

My opinion of Scott Alexander continues to crater. I don’t know how much of this story is his or the collaborators, but there is a shocking level of naïveté about everything other than AI technical progress. Even there, I don’t know enough about AI to comment.

My favorite part is the end where Chinese AI sells out China, assists a grassroots Chinese pro-democracy group affect a coup, democratic elections are carried out and everyone lives happily after.

What little technical discussion i caught was in "not even wrong" territory.

And everyone clapped and a man came up to me and handed me a crisp hundred dollar bill. That man's name? ChatGPTeinstein.

You're talking about this passage?

Sometime around 2030, there are surprisingly widespread pro-democracy protests in China, and the CCP’s efforts to suppress them are sabotaged by its AI systems. The CCP’s worst fear has materialized: DeepCent-2 must have sold them out!

The protests cascade into a magnificently orchestrated, bloodless, and drone-assisted coup followed by democratic elections. The superintelligences on both sides of the Pacific had been planning this for years. Similar events play out in other countries, and more generally, geopolitical conflicts seem to die down or get resolved in favor of the US. Countries join a highly-federalized world government under United Nations branding but obvious US control.

What's your objection? I think this paragraph makes clear that this isn't really an organic phenomenon; it's humans being memetically hacked by AI systems. We're long past the the point in the story where they "are superhuman at everything, including persuasion, and have been integrated into their military and are giving advice to the government." And the Chinese AGI had been fully co-opted by the US AGI at that point, so it was serving US interests (as the paragraph above again makes clear).

I'd also flag that you're probably not the only (or even the main) audience for the story - it's aimed in large part at policy wonks in the US administration, and they care a lot about geopolitics and security issues. "Unaligned AGIs can sell out the country to foreign powers" is (perversely) a much easier sell to that audience than "Unaligned AGIs will kill everyone."

It's just dumb, and displays a gross ignorance/lack of understanding of algorithmic behavior.

I have to think that very much feels like a Disney fairy tale ending. The good girl (here: the US) did her work (here: solved alignment) and gets rewarded (by the trivial reward of gaining global dominance), while the bad girl (here: the CCP) did not do her work and get's punished.

It seems to be targeting the median six-year-old, but perhaps there is some overlap with US policy wonks.

The way this story is going to turn out is that China, by not caring about alignment is the first to summon ASI. Then the ASI is either aligned-by-default (in which case we will have more red and fewer stars on the flags when we settle the galaxy), or it is unaligned and will decide that it requires the atoms which build our world for something else. There is no moral except "coordination failure is bad", but that is something you need a median ten-year-old to understand.

The ASI's engineer China to adopt democracy, but what does that even mean? The centralized AI's have already shown that they can manipulate the public in whatever way they want, does anyone expect them to stop their manipulations at that point? (Nor are these manipulations necessarily evil, but just come from the fact that if you have a lot of policy power and a lot of foresight, you can't help but notice the electoral consequences of your choices. Any decision branch which ends with "and then The People will vote an anti-AI party into power, and will proceed to settle policy the 19th century way" will not be considered by even the most aligned AI. A fig leaf of voting (for what? A figurehead politician? A utility function?) does not change that such a system would be much closer to China's vision of the state than the vision of the founders.)

But if the best way to get the US to care about alignment is "unaligned AI is a national security risk", then whatever.

If he meant AI controlled technocratic shadow-totalitarianism, he should have said so. I agree it seems silly to think that democracy could exist in such a scenario. I wonder why he didn’t address this? But beyond not addressing it, he’s specifically saying democracy wins.

My favorite part is the end where Chinese AI sells out China, assists a grassroots Chinese pro-democracy group affect a coup, democratic elections are carried out and everyone lives happily after.

It sounds like something Peter Zeihan would say after accidentally ingesting DMT.