This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.
Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.
We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:
-
Shaming.
-
Attempting to 'build consensus' or enforce ideological conformity.
-
Making sweeping generalizations to vilify a group you dislike.
-
Recruiting for a cause.
-
Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.
In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:
-
Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.
-
Be as precise and charitable as you can. Don't paraphrase unflatteringly.
-
Don't imply that someone said something they did not say, even if you think it follows from what they said.
-
Write like everyone is reading and you want them to be included in the discussion.
On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.
Jump in the discussion.
No email address required.
Notes -
In reading your post and contemplating it, I realized that a very likely response that humans would have to a significantly super-humanly intelligent AI is to worship it as a god. I suppose this is old hat. There must be hundreds of old sci-fi stories with this premise. But I used to find this premise hokey, whereas now it actually seems pretty plausible. And it is especially plausible if the AI is super-humanly charming as well as being super-humanly intelligent in a scientific way. And why wouldn't it be super-humanly charming? This AI would combine in one being an intelligence that is beyond any of humanity's geniuses and the charisma of a pop megacelebrity like Elvis or Michael Jackson, or a politician like Hitler, but on steroids. The likely human reaction to such a being is not just fawning support, such as Obama gets from Democrats or Trump from Republicans, it would probably be something more like religious awe.
Some might object that humans would not feel such an awe because they would be aware that the machine intelligence was a human creation. But I am not convinced by that. Humans are capable of worshipping Jesus even though Jesus was born from a human woman. It would be easy for future humans to imagine that the super-humanly intelligent AI was actually some sort of being from beyond the metal, some kind of essence that the universe suddenly decided to activate in that metal like Jesus becoming incarnate in a human body.
Granted, the AI wouldn't have a human body, unlike say Michael Jackson, who could get worshipped as a demi-god off the power of his accomplishments and raw charisma by standing still and turning his head occasionally, and who still has the largest online defense force of any modern celebrity, one that includes thousands of people who worship him and constantly argue online against the idea that he was a pedophile. But it would have so many other advantages that I'm not sure the lack of a human body would matter. For all I know, it might even help. Humans have never yet in their history, unless you credit stories about gods or aliens, been exposed to an intelligence that is genuinely significantly super-human.
As long as I'm talking about Michael Jackson, I might as well mention that he was so beloved and worshiped that he could release a music video that is basically fascist propaganda and get away with it. Check it out, the HIStory Teaser is both hilarious and epic. Even if it was meant to be satirical, it is still probably the best fascist music video that has been made in the West since Leni Riefenstahl, or maybe parts of the Pink Floyd The Wall movie.
I’d argue that on a low level we’ve been worshiping AI and before that computers. The number of times I’ve seen someone ask AI a question and just assume AI is correct is pretty darn high. They’ll ask ChatGPT a question and post the answer as though this is all that’s needed to know the answer. That’s pretty close to divination— ask a question, get an answer from the gods and then just go with it. And before that, you could find the same thing with making computer models or researching on the internet. You’d get an answer from a computer analysis and never ask what assumptions are in the model, it was done on a computer after all. With punch cards and everything. It has to be right. Or once we had internet, any information found by Google search would be assumed correct. It’s just built in, I think, that if you think the box in front of you is intelligent, you assume it’s right and simply accept that what it says is true.
This makes the word "worshipping" meaningless.
More options
Context Copy link
More options
Context Copy link
So, my church doesn't have an official position on this, but the unofficial one I've seen in a lot of places is that if 'true' GAI happens it'll be used as a puppet by demons.
This makes sense on a secular level if we translate demons to something like Scott's take on Moloch. Naturally-emergent suboptimal (or downright deleterious) local minima / pernicious local attractors in the possibility space of ways-of-being, of niches.
But I don't see why it needs to be either/or.
It's a surprisingly wise position re: human Agency but it's still going to be very easy to manipulate by any system with above human intelligence.
More options
Context Copy link
I am not a member of any organized religion, but I think that your post nails something very important.
And is pragmatic intelligence really anything other than an ability to objectively survey the field, especially when that means being able to see past the local maximum to a higher one?
But though I agree with you at least in that there is a similarity between the religious notion of a demon and the possible darkness of AI, I am not convinced that the argument makes sense unless I accept your metaphysical perspectives. From a secular perspective, why would AI be more drawn to chaos than humans are?
I suppose the non-secular, more optimistic argument would hold that humans have some kind of extra sauce, something that naturally makes them less demonic, maybe more altruistic, than an AI following pure gradient descent on matrix math would have. But what is the evidence that this is true?
And I say this as someone who thinks that consciousness might be beyond the ability of humans to ever understand. But when it comes to ordered/demonic, I'm not sure why the AI would tend to be more demonic, unless I buy into some kind of metaphysics that I see no reason to buy into so far at least.
Darwin. The human brain, and its various chordate forerunners, is the product of hundreds of millions of years of ruthless selection forces; who knows how many vulnerabilities and failure modes both gross and subtle have been winnowed out over the aeons?
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link