This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.
Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.
We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:
-
Shaming.
-
Attempting to 'build consensus' or enforce ideological conformity.
-
Making sweeping generalizations to vilify a group you dislike.
-
Recruiting for a cause.
-
Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.
In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:
-
Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.
-
Be as precise and charitable as you can. Don't paraphrase unflatteringly.
-
Don't imply that someone said something they did not say, even if you think it follows from what they said.
-
Write like everyone is reading and you want them to be included in the discussion.
On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.
Jump in the discussion.
No email address required.
Notes -
It is profoundly heart breaking watching people you otherwise respect and have affection for repeat nonsensical NPC talking points, as though they were their own original thoughts. It just completely breaks your perception of them. It reminds me when I was reading the Prince of Nothing series, and the main character is some genius hypnotist manipulator, and every other character he encounters goes from being an interesting individual contending for power in a Game of Thrones-esque power struggle to merely his puppet. By the end of the trilogy there are like, 3 actual characters left, and everyone else has become an NPC in thrall to him. I kind of hated it.
It's frightening above all else. It lowers my estimation of humanity on an absolute basis, versus merely impacting how I view that person. It changes how I view myself. It's like if your best friend tumbled over one day, cracked his skull wide open, and instead of flesh and blood and brains, there was just a hamsters on a wheel that quickly ran off, leaving your friend inert. And while your first thought might be "Was he always just a hamster on a wheel?" your next thought might be "Is there a hamster on a wheel in my head too?!"
It's the sort of thing that makes me wonder if LLMs aren't actually that smart, but that people are dumber than we thought. I can't think of a better analog to "Pattern matches language tokens based on a data set without any comprehension of their actual meaning" in people than just uncritically repeating NPC talking points, angrily, without considering for even a millisecond any of their broader implications. I've called it unidirectional knowledge before. You are spoon fed a list of data points, along with the only permissible conclusions you are allowed to draw from them. Do not draw outside the lines! Most people are happy not to.
Frankly I can't understand how we, as a species, made it through anything anymore. I don't understand how we progressed past city states. Maybe an elite, which really is better than us, and which really is necessary to keep us from all choking on our food because we forgot to chew (metaphorically) is real and required.
More importantly, if such an elite class of human is real, it's probably safe to assume you aren't among them. You have to face the very real possibility that you, like everyone else, just has a hamster on a wheel in their head.
Hampster wheels are fine. Or rather. As an LLM dev, I don't think there's a hard line between regurgitation and intelligence in the first place. The line comes from what you choose to regurgitate. How you choose to regurgitate. What you choose to absorb- in order to later regurgitate.
Choosing what to believe is ultimately a process. A complex process, but a process, that any sufficiently general intelligence can learn. Discernment is a process. A complex process that requires interacting with the real world, but a process, that any sufficiently general intelligence placed in the right environment can learn.
And once it's learned and cached, you can regurgitate. Iterate. Fill in your template with your context. Throw your new, more advanced tools at the wall and see what sticks. That's creativity. Then you proceduralize the things that stuck. Analyze the things that didn't using your various regurgitated analysis processes. Regurgitate those insights in your "previous work" section as you proceed to rinse and repeat.
I think most 'NPC's have brains that can support far more intelligence than their environment has made learnable. People got by in antiquity because midwits and geniuses alike scale- with limits of course, to the problems their environment requires them to solve and the tools (mental or otherwise) their environment gives them. Elites only need to tell people what to do insofar as people are incapable of testing what they're told.
More options
Context Copy link
I haven't read the Prince of Nothing series, but surely you've read Neal Stephensen? "We used to be p-zombies until (some of us) actually became sentient (maybe)" is the premise of a couple of his books.
While I sympathize with your take in general (I too know people who will just swallow The Latest Thing uncritically and there's no point talking to them about it), it's not stupidity and it's not new. People are largely group-thinkers and want to go along to get along and also lack the necessary time or energy to dig deeply into the particulars of whether a particular claim is true. Even here on the Motte we see people sometimes show up and plaster a laundry list of highly risible deepity-sounding assertions in a wall of text, and they rarely get much more than vibes-based pushback because who wants to hunt down each and every bullet point to dispute it? And on the rare occasions when someone does that, the deepity-poster disappears and returns after a while to do the same thing.
Jesse Singhal is slowly driving himself mad on Twitter because he keeps doing this with trans activists: "No, look at these fifteen studies I have carefully analyzed which show that what you are saying is not actually true!" he says for the fifteenth time, thinking that this time, Facts and Logic will make them stop calling him a transphobic Nazi.
There isn't some "elite" class of human capable of actually thinking. What we have are agreeable people who don't think most battles are worth fighting (especially at the cost of career and reputation and friendships) and a few highly disagreeable people (often on the autistic spectrum) who absolutely will fight over these things. I hesitate to say that the latter actually have much to do with building bridges and advancing civilization, even if we probably do need a few of them around.
More options
Context Copy link
Yes, but I find the thought quite comforting. Looking at it this way keeps me from huffing my own farts, and in the end snaps me back from changing my perception of others. I know for a fact that I do actually think about all the crap going on around us, and I know for a fact that I'm also an NPC repeating other people's talking points most of the time, so, I assume, my thoughts about my interlocutor are just an expression of frustration, rather than saying anything deeper.
After a fashion. They're needed to coordinate society at such a wide scale, but going by the ideas they're implementing they're either not that bright, or comically evil, and in either case, I don't think we need them that much.
More options
Context Copy link
Have you read the scifi novel Blindsight? Gave me a similar feeling
I haven't, but I can probably ad it to my reading list. Making my way through Crime & Punishment lately, when I'm not working on a bunch of cabinet doors.
I'll +1 the recommendation of Blindsight.
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link