site banner

Culture War Roundup for the week of February 27, 2023

This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.

Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.

We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:

  • Shaming.

  • Attempting to 'build consensus' or enforce ideological conformity.

  • Making sweeping generalizations to vilify a group you dislike.

  • Recruiting for a cause.

  • Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.

In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:

  • Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.

  • Be as precise and charitable as you can. Don't paraphrase unflatteringly.

  • Don't imply that someone said something they did not say, even if you think it follows from what they said.

  • Write like everyone is reading and you want them to be included in the discussion.

On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.

10
Jump in the discussion.

No email address required.

Not even Turing himself intended the Turing test to be a serious measure of capability, it is entirely a figment of journo/sci-fi writers imaginations. I think Bing passes it right now – sure, it's crazy and dumb sometimes, but humans are also crazy and dumb, and in much the same (although not identical) manner, with pigheaded obstinacy, gaslighting, deliberate obtuseness. And from the point of view of more credulous humans, ELIZA was passing it well enough already – so the idea that it's still an open problem is inherently elitist and subjective. Crucially, it's not testing what we want to test: a machine's sentience/intelligence/consciousness or whatever it is that we are interested in cannot be reducible to its ability to deceptively mimic a human or a very humanoid agent. It's both a simple task if solved with exploits, and a harder one than a mere human-level AGI if solved honestly.

A sentience that lives a single forward pass can have high superhuman «resolution», even if limited capability due to its meager context. Larger contexts, persistent «tape», training objectives and architectures emphasizing long-range coherence, clever prompts, other gimmicks can improve its external presentation, but I doubt they change much in terms of the peak cognitive power of what exists under the hood.

I've read dismissals of LLMs as glorified excel spreadsheets matching patterns of words together (Zvi, Gary Marcus, etc) and found them somewhat convincing

Well you've probably read some snippets from ChatGPT and Bing that are also delivered in an authoritative tone and cogently phrased, but turn out to be total bullshit under scrutiny. Marcus is more of a stochastic chatbot than a SoTA model, less amenable to persuasion, less interested in new evidence. I think we shouldn't worry too much about opinions of people who are outperformed by bots. Gwern's classic rant sums up this topic adequately.

however it seems like our understanding of intelligence and sentience are poor enough

I'd say our articulated understanding of what it means to «understand» something is laughable, and so we're making very little pop-philosophical progress in our discussion of how good our language models are. I want to write an effortpost on that, as well.

But plans and reality are different things.