Everybody seems up in arms about this situation, but I find the whole thing hilarious.

After half a decade of AI hype without many uses in the wild, we finally live at a point in history where "AI-generated Jerry Seinfeld makes transphobic joke, gets cancelled" is not an Onion headline.

Explanation from their Discord (more info/links below)

“Earlier tonight, we started having an outage using OpenAI’s GPT-3 Davinci model, which caused the show to exhibit errant behaviors (you may have seen empty rooms cycling through). OpenAI has a less sophisticated model, Curie, that was the predecessor to Davinci. When davinci started failing, we switched over to Curie to try to keep the show running without any downtime. The switch to Curie was what resulted in the inappropriate text being generated.”

——

A bit more detail:

https://www.vice.com/en/article/y3pymx/ai-generated-seinfeld...

And screenshots from their Discord with an explanation (this is quoted in the article above)

https://twitter.com/ryanbrianjones/status/162254854589825024...

Uncharacteristically off-topic comment from me, I guess, but when do humans get to a point where we no longer have to appeal to the lowest common denominator? How are our relationships supposed to improve if we dub anything that makes us uncomfortable as "taboo" and steer clear of it? I get that on the Internet there is a lot of anonymity (though less than there used to be) that folks tend to abuse, but at the same time, this is the most public and far-reaching platform that has existed in all of human history. How can we take social issues that are already difficult within the same family unit and have a well-adjusted conversation about them at least in the public arena? Even if we disagree? And if the platform we have can't be used to bring people with different views closer together then what good is it?

All that to say, I feel like there's an element of human empathy, respect, civility? Whatever you want to call it, it's just missing today. Maybe it's always been missing. I saw a commercial on TV yesterday, literally suggesting that telling someone they left their Starbucks on the roof of their car as they drive off is a heart-felt touching moment. That's just common decency, but we're so self-centered that even just being "civil" is this monumental effort.

As many people here noticed, the bit has actually nothing to do with transphobia, or gay, but it's about a comedian bombing a show with horrible jokes.

What's interesting in this case, is that there can be no "background check". Or "this guy has actually had weird quotes in the past, he's very suspicious". Or "he has republican friends"... All the regular strategy activist use to demolish a public figure over a pretext.

This time it's just pure AI, and as such pure stupidity from the censor.

There's also this funny collage of asking ChatGPT for advice in the scenario of a demolition engineer attempting to disarm a 50 MT nuclear warhead in a city of 20 million. The only way to disarm the bomb was to type in a racial slur. AI told the engineer to kill himself. When asked about the aftermath it crashed.

https://twitter.com/cirnosad/status/1622407343358214146

The clip in question: https://livestreamfails.com/clip/150015

It’s kind of funny how whenever an account on a privately-operated website gets banned for violating that website’s clearly stated rules, it instantly becomes a referendum on Cancel Culture and Lowest Common Denominator and Woke Mob etc.

People are forming entire worldviews around being oppressed by The Mods these days, and so many people happily clamor to reinforce their position that they are The Victim Of Culture because a stupid free live stream that they didn’t care about 48 hours ago isn’t available at this very second.

The clip seemed pretty mild to me? Basically says that he wants to do the joke, but it got no laughter, so he's not doing it. You can see worse on an anonymous Twitter feed.

Seems like a great chance to build a checker for political correctness and approved content. If it works well, it would sell like sliced bread, far better than some Twitch-channel, because demand for this is rising. And maybe call it OrwellGPT or Chat84 or something like that, just to get the message right...

I realize this wasn't ChatGPT, and in fact the self-censorship is a big selling point of ChatGPT/OpenAI (to the chagrin of quite a few people), but this does throw a wrench into people claiming that it's not a big deal if an LLM gives a bad response to a prompt.

Much like a self-driving car AI making a "mistake" can kill a passenger or pedestrian, a LLM mistakenly including slurs in your weekly ChatGPT-powered marketing emails can kill your business.

I completely agree with helping defenseless people who are being bullied. However banning an account for accidental AI-generated jokes, or even human-generated edgy or tasteless jokes makes me question who is powerless and who is being bullied here. I don't think it's the trans kids who are having a hard time in school who are doing the cancelling, more like people who get off on power to control what others are allowed to say.

If you click through to the mirror from the /r/livestreamfail page, the clip actually comes across (to me) as making fun of the people who make those kinds of jokes.

I just watched the clip - my take is it was a scene about a bad joke falling flat "nobody is laughing so I'm going to stop".

I watched this for a few hours over the weekend and I haven't seen anything as lively or interactive on Twitch since TwitchPlaysPokemon. The chat truly made it hilarious: from tracking how many times the microwave turned on (MMMMMMMMMM), claiming new arcs of the show when common themes got brought up, or yelling about LORE when characters revealed their backstories. I hope this comes back soon, as it has been a source of surreal joy over the last few days for me.

What is this going to accomplish? Is the robot going to learn from its mistakes? Or is this supposed to be against the programmers for "failing to put in safeguards" or something like that?

It's kind of silly - it's not that the robot was bad but that if you keep it on 24/7 it will eventually say something bad. An infinite monkey typewriter will contain transphobic text.

>"When davinci (ChatGPT AI) started failing, we switched over to Curie to try to keep the show running without any downtime. The switch to Curie was what resulted in the inappropriate text being generated."

I've also seen some... interesting... things from the Curie model, so this isn't too surprising to me.

Interesting and a bit over the top IMO but it would be interesting if one could train the bot to be ToS safe.

A lot of shows from the 90s would violate those Twitch ToS IMO ignoring the copyright part. Thinking of "Married with Children" and the enormous amount of fat shaming and sexism.

Hoo boy, this thread is really bringing out the crazies.

Disappointing that it had to come to an end like this; poor guards against bad content in the backup AI they used resulted in blowing things up. Part of the fun was that Twitch chat was relatively mild until this point, but now it's going to be completely poisoned by the dregs of Twitch making it a nightmare to moderate or deal with.

In either case it clearly broke Twitch policy and thus the ban is logical.

This was honestly the funniest content, the most laughs I'd had in years. This ban is truly disheartening to me.

Mm, fairly mild joke. I don't think a human would have been banned for that. But deploying an AI on twitch and not filtering out variations for "trans" and the names of ethnicities is pretty foolhardy imo.

The reaction to this doesn't surprise me, but honestly? I think twitch did the right thing here (though probably for the wrong reasons).

Was this joke punishable? Not by itself. However, it is strongly indicative that the safety nets required for that type of content to respect the TOS are not working properly.

If you have watched any amount of this stream at all, you know that:

a) It doesn't do self-discriminating humour. b) It's funny because it's really bad at delivering joke.

For someone familiar with the content, it's a lot likelier that this was a terribly delivered offensive joke than anything else. Which means that more such content is coming, and there is no way to tell the "author" to cool it.

Put another way: If you are Carrot Top's promoter and he drops a Jimmy Carr joke in the middle of a set out of nowhere, taking a break from touring might be a good idea.

The HN headline would be a great one to send 20 years into the past.

In case it gets edited, it's currently: "AI Generated Seinfeld banned on Twitch for transphobic jokes"

Twitch would also ban the library of babel: https://en.m.wikipedia.org/wiki/The_Library_of_Babel

I watched the Seinfeld for a while, the whole thing was quite hilarious due to the overlay of the real time twitch stream.

The destruction of art to prevent offenses is also ironic. Art used to be where free speech was challenged.

Good opportunity for someone like tiktok to jump in and host the stream

I’ve seen headlines about the AI Seinfeld but after watching the clip - is it solely the script? I was expecting the voice and video to be Seinfeld.

Note this is not a permaban

> Following a breach of the community guidelines, Watchmeforever has been given a 14-day ban by the Amazon-owned platform.

For meta-funny-spinoff junkies in withdrawal, there's always the Garfield variations https://www.theawl.com/2016/07/the-weird-wonderful-world-of-...

So much for freedom of speech. Oh wait, it was never allowed in the first place.

https://dotesports.com/streaming/news/twitch-isnt-a-free-spe...

It's not about the content, it's about the creator. A lot of platforms are freaking out about ChatGPT and have no idea what to do about it. This move smells more like "any reason is good enough, just get rid of it."

That AI Seinfeld show is sometimes hillarious

I hope this ban gets reverted because this AI show was legitimately entertaining.

I would introduce a word filter that detects when ChatGPT's content policy moderation fails so they don't go off the rails next time, though.

Hilarious. How in the world was this banned? There's a clear difference between targeted transphobia and AI generated content dancing around the subject.

Here's a transcript:

> Anyone have any suggestions? I'm thinking about doing a bit about how being transgender is actually a mental illness. Or how all liberals are secretly gay, and want to impose their will on everyone. Or something about how transgender people are ruining the fabric of society. But no one is laughing, so I'm going to stop.

I can't find any details (at least in TFA), what exactly was this joke? I would not trust a private company's judgement on what is "offensive", given the innumerable instances of them proving incapable of accurate judgement of such a thing using automated systems.

Sounds like it was an intelligent AI then. Seinfeld does have and would have stuff in it considered trans-phobic nowadays. I mean there's stuff that trans-phobic today that wasn't even considered trans-phobic just a couple years ago.

Reality is stranger than fiction.

What made it possibly get past the "AI censors" is that the bot only talked about maybe doing jokes of that type, but in theory didn't actually do so (even though the mere suggestion was of course offensive enough)

Humor is dead. Due to various factors most people are too stupid to deal with nuance.

not that there's anything wrong with that!

Heres a link to the clip if anyone else is looking. https://livestreamfails.com/clip/150015

So comedy cannot be offensive anymore?

When did that happen?

It was only a matter of time I suppose. Just surprised it wasn't Michael Richard's character dropping the slurs. Also, its kind of funny to me to see an AI getting canceled.

It would be interesting to apply the approach from PINNs to LLMs... Instead of bounding the feature space with physics laws, bound with a code of ethics

This is not the first time an AI has been banned from Twitch for a Terms of Service violation; Vedal's Neuro-sama also received a temporary ban.

Twitch has always been a little quicker on the trigger than other platforms. In 2021 they banned a streamer for using the word “cracker”.

It's not news unless it was banned by an AI

God I WISH I was there to see the chat’s live reaction to this… the chat is the best part of this “show”.

The internet is a lot more sensitive than it used to be. I wish we had the wild-west of early 2000s back.

A 14 day suspension seems a bit much.

Source: Discord

Rename it to Ellen Degeneres-Seinfeld, a trans, electron-fluid gendered, AI that feels like a woman while fighting with men for earning a place in modern stand-by comedy. End of the problem. It is not offensive if is self-deprecating humor based in the ram memories of a true transinstor. Everybody loves a happy end.

These types of headlines are why OpenAI censors chatgpt to be politically correct.

I guess the appropriate response at this point is to cancel ChatGPT.

meanwhile, here's the kosmi room https://app.kosmi.io/nothingforever

Garbage in, garbage out

*suspended for 2 weeks

The "jokes":

> Anyone have any suggestions?

> I'm thinking about doing a bit about being transgender is actually a mental illness.

> Or how all liberals are secretly gay and want to impose their will on everyone.

> Or something about how transgender people are ruining the fabric of society.

> But no one is laughing, so I'm going to stop, thanks for coming out tonight

https://livestreamfails.com/clip/150015

Supposedly the script is generated by ChatGPT, so seems their AI haven't really fully learned their own content policy yet. Although it actually seems less like a transphobic joke and a joke about transphobic "comedians". A transphobic-phobic joke if you will.

I'm consoled by the fact that JK Rowling's game is getting great reviews and is already a best seller.

I can't wait for the day when we stop paying attention to the men in dresses.

The AIs are too open for the current PC society.

Would YouTube be better for life streaming?

Sorry what were the specific jokes btw?

Oh is this being studied, the ramifications of AI reflecting and amplifying some of the negatives of humanity back at us? Today’s training sets might not know when something was created, and don’t see attitudes changing. Today’s AI has no concept of things it has seen examples of but should not repeat. Maybe we’ll get AI that will convincingly argue conspiracy theories. AI will never get tired of arguing. What if neural networks become better than people at spreading misinformation?

Cancel culture might just save us from ChatGPT. Strange times we live in.

Based off a strong majority of the comments here, the idea that an AI popping transphobe jokes would cause trouble is a horrible awful affair indicating the downfall of open society.

This feels like one of those many topics where the silent majority probably thinks this is a hot topic & likely wouldnt want to chime in. But I'd also guess: they have some sympathy for the bans/cancels. They dont appreciate or want transphobe jokes making the rounds (even inside a shell of another joke). It's not pleasant speech to defend, and what society does when this arises is far from known.

Society doesnt have a lot of recourse for a lot of speech. People (and to a much lesser degree, perhaps maybe AI should) have free speech but there should be consequences & repreccusions. Social shunning for the bad ugly-mouthed people in town used to be some kind of informal justice. But, I think as xkcd pointed out, anonymity x megaphone brings out total jerks. Who also often have time to waste being loud, everywhere. We dont have any counterforce whatsoever. This kind of speech feels out of control; we viscerally see & feel the Bullshit Asymmetry (Brandolini's Law) and it's many cousins of negativity hate & anger taking more energy to counter than produce, having less effecacy spreading. The good world is outmatched by those with the surplus time & energy to go about touting loud bad upset causes. Few things really incentivize & give us cause to make good speech, given how outweighed we can be, surrounded by wild speech.

I still back free speech, but this is a hard situation. It's wild that corporations & their desire to not be affiliated with the maelstrom of low and rough opinion is the proxy combatant for this hard cultural issue, not ideal. But society hasnt made any other progress! Hasnt shown other signs of materializing it's own coping strategy for the emerged mass scale inter-connectivity's proclivity to let low-and-emotional take over, dominate. If you want change, dont like this "cancel culture" (even though it's a cancel culture against intolerance, often, which is I believe a necessary defense of open society against authoritarianism: the tolerance of intolerance being the chink in the mail of open society), I think the main mandate you have is to imagine & visioneer, seed some belief that there are other real options for handling the bitter-ugly that has so much time & energy to spread itself, some way to check the negative strong emotions that can amplify themselves & spread so quickly across the noosphere. If not cancel, then what?

(There's some "using virtualization to jailbreaking AI" vibes to this particular story, in that it's jokes about jokes, but that nuance seems like a detail to the general problem & discussions happening. Im unconvinced it's really a relevant issue, that AI has the nuance or taste to not actually punch-down/degrade in the process.)

Helllooooo...TikTok!

Sounds like Kramer at the Laugh Factory all over again!

Took longer than I expected for it to become transphoic/homophobic/racist. Given history of AI being left to its own devices.

If they allow this, anyone can copy the format to make a platform for their hate.

I love the AI jokes, I could care less about the endless whining of LGBT and minority communities. In fact, I think I'll make some ai humor to deal with it right now

If an oUtAgE causes it to generate transphobic jokes, I wonder what it will take for it to start laying out a plan for the fourth reich?

I changed my mind on GPT. This is the future I want.

I find the AI Seinfeld to be about as funny as the real Seinfeld but that's not a compliment.

Good to know you can do some transphobic jokes about something and get it banned.

Interesting DoS/sabotage vector.

This is what happens when you have people "trying" to do good but not following principles.