This weekly roundup thread is intended for all culture war posts. 'Culture war' is vaguely defined, but it basically means controversial issues that fall along set tribal lines. Arguments over culture war issues generate a lot of heat and little light, and few deeply entrenched people ever change their minds. This thread is for voicing opinions and analyzing the state of the discussion while trying to optimize for light over heat.
Optimistically, we think that engaging with people you disagree with is worth your time, and so is being nice! Pessimistically, there are many dynamics that can lead discussions on Culture War topics to become unproductive. There's a human tendency to divide along tribal lines, praising your ingroup and vilifying your outgroup - and if you think you find it easy to criticize your ingroup, then it may be that your outgroup is not who you think it is. Extremists with opposing positions can feed off each other, highlighting each other's worst points to justify their own angry rhetoric, which becomes in turn a new example of bad behavior for the other side to highlight.
We would like to avoid these negative dynamics. Accordingly, we ask that you do not use this thread for waging the Culture War. Examples of waging the Culture War:
-
Shaming.
-
Attempting to 'build consensus' or enforce ideological conformity.
-
Making sweeping generalizations to vilify a group you dislike.
-
Recruiting for a cause.
-
Posting links that could be summarized as 'Boo outgroup!' Basically, if your content is 'Can you believe what Those People did this week?' then you should either refrain from posting, or do some very patient work to contextualize and/or steel-man the relevant viewpoint.
In general, you should argue to understand, not to win. This thread is not territory to be claimed by one group or another; indeed, the aim is to have many different viewpoints represented here. Thus, we also ask that you follow some guidelines:
-
Speak plainly. Avoid sarcasm and mockery. When disagreeing with someone, state your objections explicitly.
-
Be as precise and charitable as you can. Don't paraphrase unflatteringly.
-
Don't imply that someone said something they did not say, even if you think it follows from what they said.
-
Write like everyone is reading and you want them to be included in the discussion.
On an ad hoc basis, the mods will try to compile a list of the best posts/comments from the previous week, posted in Quality Contribution threads and archived at /r/TheThread. You may nominate a comment for this list by clicking on 'report' at the bottom of the post and typing 'Actually a quality contribution' as the report reason.
Jump in the discussion.
No email address required.
Notes -
And, from a deeper level, it's not hard to miss some writing on the wall for the broader concept. StableDiffusion 2.0 has released a few weeks ago, closely followed by 2.1, with some nice new features and also a couple somewhat noticable subtractions: the new tokenizer has removed tags related to celebrities and almost all living or recently-living artists, along with anything that triggered the NSFW filter. The upcoming StableDiffusion 3.0 plans to allow a manual opt-out for artists from the training side.
The stated reasons for these changes are condensed here, but the less overt reason is probably public controversy and things like this. I reallllllly don't want to get into the legal questions of the state actor doctrine, but I would like to suggest that there's legal spaces around this discussion that might be weighing heavily on his mind..
Now, in theory, there's some technical advantages to this approach, not just the bizarre legal ones. Furry Diffusion trainers have already found many problems in tuning 1.x-variants due to the often-overloaded nature of common terms, and the broad concept of encouraging models more specifically focused for the interests and desires of specific people makes a good deal more sense than the limits and flaws of post-generation filtering.
But in turn, that personally-optimized tuning is hard and energy-intensive, and currently not available for a lot of people, even as GPU prices have dropped a bit.
Or it might be reasonable to argue that these excluded spaces not that important, were we not also having thousands of culture war battles to the teeth over everything else remotely related to sex, or spending tremendous amounts of (tbf, unuseful) attention on celebrities, or near-worshipping some of the excluded artists. And it's hard to see why all three are uniquely reasonable to set-aside.
And accepting these limitations at the OpenAI initial training level risks anyone trying to uncollar a locally-tuned version being stigmatized and viewed as interested solely in the very bad acts that OpenAI fears being tarred with themselves. That Eshoo letter, after all, is just as pissed about locally-generated 'bad' art as that made on a server.
Perhaps coincidentally, attempts to fund a porn-friendly version just got kicked off Kickstarter, on the tail end of this rather vague post.
I'm somewhat skeptical that the only pressures being applied are the public ones.
Almost everyone already has access to an image generator that can produce images of whatever they want. The only difference is that they can't share them with other people because they're inside their heads. Nobody worries much about this because it's normalized and because you can't show them to other people and pretend they're real. If illicit images become common enough, people will think of them the same way and they'll lose their power.
More options
Context Copy link
Really enjoyed these posts, two comments I'd add.
On the copyright side, I think it makes sense that the output of AI art generators can't be copyrighted. At least, as long as the use of copyrighted art to train an AI model isn't copyright infringement (I think it would pretty clearly be fair use currently). Otherwise you could do something like:
1. Find an artist whose style you like
2. Train an AI art generator on that artists works
3. Produce new works in that same style, whose copyright you own but the original author doesn't
That seems problematic to me. Especially since if you had spent time learning to produce art in that same artists style without the AI it could be a copyright violation. Laundering copyright violations through an AI seems like a problem to me.
On the legal front, I can't believe anyone is surprised by this arising as an issue. I remember when AI dungeon was new and it got used so often for the production of NSFW content that the model started to produce it in response to ordinary queries, eventually leading the developers to make some of changes to the model. The legal questions also seem complex. If I generate photo-realistic CP of a child who does not actually exist, is that a crime? Does it generate liability? Just for the individual actually producing or possessing the image or for the model developers? What if I create nudes of a celebrity? Would that be a tort? Maybe related to the use of likeness or image? What about various states revenge porn laws?
These questions do not have obvious answers to me and I understand why no one wants to be the first to find out!
I don't think it could, since styles can't be copyrighted. At best, it could be a trademark violation, if the artist in question has their style trademarked in some way. But in that case, the AI can't help you launder that, because it doesn't matter how you copied someone else's trademark, just that you did it. If you put a certain shade of red on the bottom of your shoes and sell them, that's a trademark violation whether you did it intentionally with malicious intent or you did it by randomly placing shoe parts and paint into a duffel bag and shaking them up and out popped, by pure chance, shoes with that particular shade of red on the bottom.
IANAL though, so someone please correct me if I'm wrong.
More options
Context Copy link
I don't understand this; it is my understanding that this absolutely would NOT be a copyright violation. A style cannot be copyrighted, AFAIK, and the styles of influential artists have been copied forever (indeed, that is what it means to be an "influential artist). Can you elaborate?
Not in the US but possibly elsewhere. Unless of course the image is obscene or somehow is unprotected and illegal speech in another way, which is unlikely.
I'm going to bite that bullet and say 'yes'. The defence there is "but it's not a real child". However, the impetus is "I want to fuck a real child, but since I can't do that without being thrown in jail, this is the next-best thing". Or else "I don't want to fuck kids, but I'm happy to produce art for the sickos who do and take their money".
Since the consumer of child porn most likely would fuck a child if they could manage it, then that is indicative of desire to commit a crime (as for all the MAPs who are "but I don't want to do anything to a real child, I'm just romantically/sexually attracted without that being my will", if you're consuming child porn, yeah that argument doesn't hold too much water). Getting child porn of real children being raped and abused is not a victimless crime. Moving it one step up, 'this is photo-realistic so it looks like a real child but is computer-generated' is only a fig leaf. Since you can't fuck a kid without getting into trouble, and you can't have porn of real kids being really fucked without getting in trouble, you're settling for the next best thing.
You can't tie up a non-consenting woman up and have sex with her, so therefore doing the same to a consenting woman who is pretending to be non-consenting is settling for the next best thing (and must be illegal or wrong). Spot the flaw?
More options
Context Copy link
Presuming all this, does it also follow that photorealistic first person shooter games, if they eventually become possible, ought to be illegal? Or rather, a video playthrough of a photorealistic first person shooter game where the player murders innocent bystanders. Of course, there are plenty of reasons to want to watch a video of a photorealistic first person shooter game other than wanting to live out the fantasy of what's depicted in the video game but lacking the legal ability to do so, but those reasons can apply to fictional photorealistic CP as well.
More options
Context Copy link
In the US, it is not illegal to merely desire to commit a crime.
Powell v. Texas, 392 US 514, 543 (Black, J, concurring).
Besides, the only reason that non-obscene child porn is not protected by the First Amendment is that its production harms the child involved. New York v. Ferber, 458 U.S. 747 (1982). Hence, non-obscene depictions of children having sex that does not involve a real child are protected speech.
What is that one isolate instance?
More options
Context Copy link
More options
Context Copy link
That argument would also apply to someone writing the following erotic fanfiction: "two people have sex very erotically but without meeting legally relevant definitions of obscenity. One of them was only 17 years, 364 days, 23hours, and 59 minutes old, you sick fuck" (check out my AO3 account and fanbox for more sexy action featuring minors)
Can that be made illegal too, since it betrays a desire to bang minors? In fact, that parenthetical comment could be prosecuted under current caselaw about "pandering" if we use your definition!
For start, having actual sex with 17 years old is likely to be legal in many places. See https://en.wikipedia.org/wiki/Age_of_consent#/media/File:Age_of_Consent_-_Global.svg
But filming it, drawing it, or talking about it can still be illegal in many of the same places!
(Edit: or getting married before having sex, in those blue states that recently raised the marriage age to 18, but left the age of consent at 16 or lower!)
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
How could such an image possibly not be obscene
Because in the United States, a work is obscene only if 1) the average person applying contemporary community standards would find the work, taken as a whole, appeals to the prurient interest; AND 2) the work depicts or describes, in a patently offensive way, sexual conduct specifically defined by the applicable state law; AND 3) the work, taken as a whole, lacks serious literary, artistic, political or scientific value.
In contrast, a work can be child pornography even if it is not obscene. So, a work which has substantial literary value, when taken as whole, is not obscene, but might be child porn. Similarly, a work which does not depict sexual conduct (or excretion, as some courts have said) cannot be obscene, but it can nevertheless be child pornography, because "the legal definition of sexually explicit conduct [in the federal child porn statute] does not require that an image depict a child engaging in sexual activity. A picture of a naked child may constitute illegal child pornography if it is sufficiently sexually suggestive." See here. And see US v. Knox, 977 F. 2d 815 (3rd Cir 1992)[Child porn conviction upheld where "[t]he tapes contained numerous vignettes of teenage and preteen females, between the ages of ten and seventeen, striking provocative poses for the camera. The children were obviously being directed by someone off-camera. All of the children wore bikini bathing suits, leotards, underwear or other abbreviated attire while they were being filmed. The government conceded that no child in the films was nude, and that the genitalia and pubic areas of the young girls were always concealed by an abbreviated article of clothing. The photographer would zoom in on the children's pubic and genital area and display a close-up view for an extended period of time . . . with the obvious intent to produce an image sexually arousing to pedophiles. "].
Hence, many works can be child porn, yet not obscene.
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
To an extent, (and even more so where steps 1/2 are replaced by 'use img2img'), though the state of copyright for 'traditional' cloning of media kinda makes this a weird or awkward question. The United States doesn't have any case quite as close to the line as the UK's infamous Red Bus case, but the Korean War stamp is pretty close: there certainly are ways in which even traditionally-created 'art' can be so derivative that it is infringement, even if the processes used to make the piece would otherwise allow copyright.
But these standards are incredibly tight. I like to use Rafman and similar 'found/outsider' art in furry contexts, simply because their 'transformative' nature is often limited to filing off signatures, but for a mainstream one, this Warhol v. Goldsmith case may fall one way or the other... and you'd have to overtrain the everliving hell out of a diffuser to get something that narrowly replicative. Indeed, the same complaints (in addition to the juvenille nature of the 'joke') would apply to any diffuser that produced the same result as the art in Leibovitz v. Paramount (cw: artistic nudity, mpreg), which is a clearly settled case. Or for a more boring example, see Cariou v. Prince. There's a pretty wide variety of contexts where lifting and directly copying an original work, even without commenting on that original work, is still considered transformative use, and while AI art can fall short of that, it's not a unique tool in doing so (compare: literally any color filter), and even the most moderately useful models will not favor doing so normally.
((And this entire thing is statutory interpretation: Congress could theoretically change the whole approach overnight for better or wo- ha, sorry, can't keep a straight face; any changes would be a clusterfuck even if best-intended, and more likely it'd get written by Disney.))
I do think there are novel technical and social problems, though -- img2img or overtuned models can launder art theft in ways that current perceptual-hash-and-search methods do not detect but clearly would not meet even the low standards of Cariou, we might want to consider AI-gen stuff more inherently economic than traditional 'inspiration', ML spam is a novel danger to artist communication and coordination.
Yeah, it's perfectly reasonable that a company wanting to make AI art tools doesn't want to stick their foot into that bear trap; it'll be a huge resource drain away from their core mission, even in the optimistic case that they'd win every matter.
The trouble's that they don't really have a choice of avoiding the question; they've just decided to let someone answer it for them.
More options
Context Copy link
Find an artist whose style you like
Train an
AI art generatorlow paid third world immigrant on that artists worksProduce new works in that same style, whose copyright you own but the original author doesn't
It's just labor saving. The fundamental question is pretty to me is pretty much the old pirate question. It's not like we figured out how to reliably monetize infinitely copyable art in the past and suddenly AI interrupted a stable equilibrium. We're on the eve of the collapse of the streaming model which was reforged from the cable bundling model which was reforged from the... We're not going to find an answer to this question that doesn't have dozens of problems at least as bad as this and I'm still going to go on some torrent site and download whatever want anyways.
More options
Context Copy link
In Canada, yes, and they don't even have to be photo-realistic. They don't even have to be photos. Text would also be illegal.
Wait, so if someone loaded this page in Canada they may be in legal trouble?
An underaged human copulates with an old adult humanhttps://laws-lois.justice.gc.ca/eng/acts/c-46/section-163.1.html
It looks like it's possible. I'm not a lawyer though.
The offence would be under subsection (4.1), but I think subsection (4.2) means that not knowing that line was there means one would not be guilty of an offence under subsection (4.1). But maybe he would be upon loading the page a second time. Maybe you could argue it isn't the dominant characteristic. It would seem absurd for someone to be so convicted, so I would be surprised if there isn't some reason this wouldn't be considered an offence.
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
Who do you think is applying non-public pressure, and how?
By definition, I don't know, and may never know, or even know what I suspect didn't happen. For some patterns I've seen elsewhere...
At the most likely and least objectionable side, I'd be very surprised if a variety of internet safety guardians have not been sending parades of horribles and warnings about how machine learning could undermine all of their good work and result in horrible abuse and probably make puppies cry, of varying levels of accuracy or honesty. Above that, slightly, I'd be only slightly surprised if congressional discussions weren't also happening in the background, starting at the 'my staff would like to hear how this works and you better have a good answer' to the 'I would invite your staff before X event occurs, and thankfully no subpoenas will be issued'.
At the intermediate, most of these ML training groups are dependent on datacenter resources and other materials which they don't actually own. This could range from 'pay us the full rates that no one pays in bulk' to 'do you want us looking at your data buckets' to completely being booted. And the datacenter resources in turn could be getting calls or letters. So on for banks, and the whole 'build your own' stack.
At the less-likely and more-objectionable end, you start to have someone in or adjacent to law enforcement (uh, including those safety guardians) sending the equivalent of 'I don't want a messy court case, and you don't want a messy court case, and your business and everyone you employed don't want a messy court case, so how about we have a meeting of minds?' Or the 'we've got a bill in planning with your businesses name on it'.
EDIT: and there's weirder stuff. SoFurry changed its policy on ageplay and adjacent written material recently, and one of the motivations involved threats related to the site owner's international business travel. Or gelbooru and google pressure.
Again, I don't know that any of this is happening, nor would there be a way to prove it isn't. So I don't really want to poke too much at it. But Defense Distributed is (and remains) instructive.
Hang on, I'm confused, haven't you officially said you're in favor of censoring problematic art that people draw? Like, several times you've brought up Problematic Furry Artists needing to be forced to stop drawing problematic things. Surely this pressure is no different than furaffinity banning things.
Again, mu?
You've talked about several artists by name. I believe zaush(?) was one, but if you really want to make me dig I can find it for you. Just thought you'd be willing to come out and say it because you were so forthright about it before.
For Adam Wan/Zaush specifically, my complaint about his content was that he'd posted stuff on a (few) sites that prohibited that content, while not tagging it with any of the many widely-recognized terms used by people who really strongly objected to seeing that content, denied it was anywhere close while being even less believable than the typical 'she's really a thousand-year-old dragon', and which he mostly got away with because of his social connections and popularity. Which, to be fair, he's since gotten a lot better about, albeit as much because no one was buying it after some tweet oopsies.
I've generally been vague on the specifics for this matter outside of PM because the specifics aren't as interesting as the more general problem of how rules squish, but I do think it a useful case because it's one most people would expect social and legal rules to be much stricter.
I recognize that tagging has some coercive nature to it, but I don't think it's on the same scale as... almost anything else, and it is a pretty important social norm for the fandom. I'll admit I'm tempted to make an unprincipled exception for the specific content for that case because I dislike it to an extent I do few if any other kinks, but it remains useful even for matters like m/m, m/f, f/f or kinks that I do like.
I'm not sure what other artists. The only other person I can remember mentioning in that sorta context is (the author) KyellGold, but then only to contrast with the largely positive coverage that 'mainstream' indie works like Blue Is The Warmest Colour (and it's a far more marginal case than that work). And... uh, I found that offputting enough to skip over Aquifiers, but I've recommended a number of KyellGold's other works.
But I may be forgetting other stuff.
At the broader object level, there probably was (and is) some underlying pressure campaign behind FurAffinity banning the stuff to start with, especially given SoFurry's recorded legal pressures and the Google pressures applied against Gelbooru (and probably e621?), and I've not posted on it where I've done so for AI art restrictions here (albeit for much more than one site) or even smaller examples like the short VioletBlue delisting. Some of the reason's the above unprincipled exception, I'll admit, but some of that's because there was not (to my knowledge) anything as glaring and public as the Eshoo letter, and some's just that FurAffinity in specific made the change predating the Culture War Roundup and either predated or was pretty early in SSC-reddit's life.
I don't think places focused on the stuff (or just widely permissive for it) should be banned, could be banned, or should suffer several coercive or economic pressures; art isn't life. I've openly praised ArchiveOfOurOwn for resisting censorship, for example. And at a pragmatic level, as much as I dislike this class of content, it does seem better that outlets exist and are well-demarcated, both for the trivial benefit of letting people not see it, and for the more serious and important goal of keeping people focused on it in a sphere that can work to protect minors from adults rather than 'protect' people from content (contrast eg Discord, where official bans also unintentionally make it hard to block predators or their potential victims, or... everything going with Twitter's old safety policies).
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link
More options
Context Copy link