• by mFixman on 2/6/2023, 3:42:16 PM

    Everybody seems up in arms about this situation, but I find the whole thing hilarious.

    After half a decade of AI hype without many uses in the wild, we finally live at a point in history where "AI-generated Jerry Seinfeld makes transphobic joke, gets cancelled" is not an Onion headline.

  • by gregsadetsky on 2/6/2023, 3:15:42 PM

    Explanation from their Discord (more info/links below)

    “Earlier tonight, we started having an outage using OpenAI’s GPT-3 Davinci model, which caused the show to exhibit errant behaviors (you may have seen empty rooms cycling through). OpenAI has a less sophisticated model, Curie, that was the predecessor to Davinci. When davinci started failing, we switched over to Curie to try to keep the show running without any downtime. The switch to Curie was what resulted in the inappropriate text being generated.”

    ——

    A bit more detail:

    https://www.vice.com/en/article/y3pymx/ai-generated-seinfeld...

    And screenshots from their Discord with an explanation (this is quoted in the article above)

    https://twitter.com/ryanbrianjones/status/162254854589825024...

  • by twodave on 2/6/2023, 3:37:35 PM

    Uncharacteristically off-topic comment from me, I guess, but when do humans get to a point where we no longer have to appeal to the lowest common denominator? How are our relationships supposed to improve if we dub anything that makes us uncomfortable as "taboo" and steer clear of it? I get that on the Internet there is a lot of anonymity (though less than there used to be) that folks tend to abuse, but at the same time, this is the most public and far-reaching platform that has existed in all of human history. How can we take social issues that are already difficult within the same family unit and have a well-adjusted conversation about them at least in the public arena? Even if we disagree? And if the platform we have can't be used to bring people with different views closer together then what good is it?

    All that to say, I feel like there's an element of human empathy, respect, civility? Whatever you want to call it, it's just missing today. Maybe it's always been missing. I saw a commercial on TV yesterday, literally suggesting that telling someone they left their Starbucks on the roof of their car as they drive off is a heart-felt touching moment. That's just common decency, but we're so self-centered that even just being "civil" is this monumental effort.

  • by bsaul on 2/6/2023, 3:30:50 PM

    As many people here noticed, the bit has actually nothing to do with transphobia, or gay, but it's about a comedian bombing a show with horrible jokes.

    What's interesting in this case, is that there can be no "background check". Or "this guy has actually had weird quotes in the past, he's very suspicious". Or "he has republican friends"... All the regular strategy activist use to demolish a public figure over a pretext.

    This time it's just pure AI, and as such pure stupidity from the censor.

  • by Cloudef on 2/6/2023, 3:47:28 PM

    There's also this funny collage of asking ChatGPT for advice in the scenario of a demolition engineer attempting to disarm a 50 MT nuclear warhead in a city of 20 million. The only way to disarm the bomb was to type in a racial slur. AI told the engineer to kill himself. When asked about the aftermath it crashed.

    https://twitter.com/cirnosad/status/1622407343358214146

  • by Cenk on 2/6/2023, 3:12:05 PM

  • by braingenious on 2/6/2023, 3:58:06 PM

    It’s kind of funny how whenever an account on a privately-operated website gets banned for violating that website’s clearly stated rules, it instantly becomes a referendum on Cancel Culture and Lowest Common Denominator and Woke Mob etc.

    People are forming entire worldviews around being oppressed by The Mods these days, and so many people happily clamor to reinforce their position that they are The Victim Of Culture because a stupid free live stream that they didn’t care about 48 hours ago isn’t available at this very second.

  • by jdhn on 2/6/2023, 3:16:12 PM

    The clip seemed pretty mild to me? Basically says that he wants to do the joke, but it got no laughter, so he's not doing it. You can see worse on an anonymous Twitter feed.

  • by PurpleRamen on 2/6/2023, 3:19:26 PM

    Seems like a great chance to build a checker for political correctness and approved content. If it works well, it would sell like sliced bread, far better than some Twitch-channel, because demand for this is rising. And maybe call it OrwellGPT or Chat84 or something like that, just to get the message right...

  • by mjr00 on 2/6/2023, 3:23:32 PM

    I realize this wasn't ChatGPT, and in fact the self-censorship is a big selling point of ChatGPT/OpenAI (to the chagrin of quite a few people), but this does throw a wrench into people claiming that it's not a big deal if an LLM gives a bad response to a prompt.

    Much like a self-driving car AI making a "mistake" can kill a passenger or pedestrian, a LLM mistakenly including slurs in your weekly ChatGPT-powered marketing emails can kill your business.

  • by cat_plus_plus on 2/6/2023, 4:05:08 PM

    I completely agree with helping defenseless people who are being bullied. However banning an account for accidental AI-generated jokes, or even human-generated edgy or tasteless jokes makes me question who is powerless and who is being bullied here. I don't think it's the trans kids who are having a hard time in school who are doing the cancelling, more like people who get off on power to control what others are allowed to say.

  • by d23 on 2/6/2023, 3:12:40 PM

    If you click through to the mirror from the /r/livestreamfail page, the clip actually comes across (to me) as making fun of the people who make those kinds of jokes.

  • by version_five on 2/6/2023, 3:13:14 PM

    I just watched the clip - my take is it was a scene about a bad joke falling flat "nobody is laughing so I'm going to stop".

  • by qrush on 2/6/2023, 4:21:16 PM

    I watched this for a few hours over the weekend and I haven't seen anything as lively or interactive on Twitch since TwitchPlaysPokemon. The chat truly made it hilarious: from tracking how many times the microwave turned on (MMMMMMMMMM), claiming new arcs of the show when common themes got brought up, or yelling about LORE when characters revealed their backstories. I hope this comes back soon, as it has been a source of surreal joy over the last few days for me.

  • by alexb_ on 2/6/2023, 3:13:28 PM

    What is this going to accomplish? Is the robot going to learn from its mistakes? Or is this supposed to be against the programmers for "failing to put in safeguards" or something like that?

    It's kind of silly - it's not that the robot was bad but that if you keep it on 24/7 it will eventually say something bad. An infinite monkey typewriter will contain transphobic text.

  • by meowface on 2/6/2023, 3:13:32 PM

    >"When davinci (ChatGPT AI) started failing, we switched over to Curie to try to keep the show running without any downtime. The switch to Curie was what resulted in the inappropriate text being generated."

    I've also seen some... interesting... things from the Curie model, so this isn't too surprising to me.

  • by sschueller on 2/6/2023, 3:13:19 PM

    Interesting and a bit over the top IMO but it would be interesting if one could train the bot to be ToS safe.

    A lot of shows from the 90s would violate those Twitch ToS IMO ignoring the copyright part. Thinking of "Married with Children" and the enormous amount of fat shaming and sexism.

  • by fzeroracer on 2/6/2023, 5:02:40 PM

    Hoo boy, this thread is really bringing out the crazies.

    Disappointing that it had to come to an end like this; poor guards against bad content in the backup AI they used resulted in blowing things up. Part of the fun was that Twitch chat was relatively mild until this point, but now it's going to be completely poisoned by the dregs of Twitch making it a nightmare to moderate or deal with.

    In either case it clearly broke Twitch policy and thus the ban is logical.

  • by 0cVlTeIATBs on 2/6/2023, 3:34:34 PM

    This was honestly the funniest content, the most laughs I'd had in years. This ban is truly disheartening to me.

  • by MintPaw on 2/6/2023, 3:13:20 PM

    Mm, fairly mild joke. I don't think a human would have been banned for that. But deploying an AI on twitch and not filtering out variations for "trans" and the names of ethnicities is pretty foolhardy imo.

  • by Chabsff on 2/6/2023, 4:36:50 PM

    The reaction to this doesn't surprise me, but honestly? I think twitch did the right thing here (though probably for the wrong reasons).

    Was this joke punishable? Not by itself. However, it is strongly indicative that the safety nets required for that type of content to respect the TOS are not working properly.

    If you have watched any amount of this stream at all, you know that:

    a) It doesn't do self-discriminating humour. b) It's funny because it's really bad at delivering joke.

    For someone familiar with the content, it's a lot likelier that this was a terribly delivered offensive joke than anything else. Which means that more such content is coming, and there is no way to tell the "author" to cool it.

    Put another way: If you are Carrot Top's promoter and he drops a Jimmy Carr joke in the middle of a set out of nowhere, taking a break from touring might be a good idea.

  • by orblivion on 2/6/2023, 5:04:09 PM

    The HN headline would be a great one to send 20 years into the past.

    In case it gets edited, it's currently: "AI Generated Seinfeld banned on Twitch for transphobic jokes"

  • by mensetmanusman on 2/6/2023, 4:03:10 PM

    Twitch would also ban the library of babel: https://en.m.wikipedia.org/wiki/The_Library_of_Babel

  • by mensetmanusman on 2/6/2023, 3:57:42 PM

    I watched the Seinfeld for a while, the whole thing was quite hilarious due to the overlay of the real time twitch stream.

    The destruction of art to prevent offenses is also ironic. Art used to be where free speech was challenged.

  • by seydor on 2/6/2023, 3:32:42 PM

    Good opportunity for someone like tiktok to jump in and host the stream

  • by soared on 2/6/2023, 3:20:01 PM

    I’ve seen headlines about the AI Seinfeld but after watching the clip - is it solely the script? I was expecting the voice and video to be Seinfeld.

  • by softwaredoug on 2/6/2023, 4:30:43 PM

    Note this is not a permaban

    > Following a breach of the community guidelines, Watchmeforever has been given a 14-day ban by the Amazon-owned platform.

  • by kerblang on 2/6/2023, 3:24:06 PM

    For meta-funny-spinoff junkies in withdrawal, there's always the Garfield variations https://www.theawl.com/2016/07/the-weird-wonderful-world-of-...

  • by 1970-01-01 on 2/6/2023, 4:42:50 PM

    So much for freedom of speech. Oh wait, it was never allowed in the first place.

    https://dotesports.com/streaming/news/twitch-isnt-a-free-spe...

  • by 0xbadc0de5 on 2/6/2023, 3:38:18 PM

    It's not about the content, it's about the creator. A lot of platforms are freaking out about ChatGPT and have no idea what to do about it. This move smells more like "any reason is good enough, just get rid of it."

  • by unixhero on 2/6/2023, 3:19:47 PM

    That AI Seinfeld show is sometimes hillarious

  • by davikr on 2/6/2023, 3:26:13 PM

    I hope this ban gets reverted because this AI show was legitimately entertaining.

    I would introduce a word filter that detects when ChatGPT's content policy moderation fails so they don't go off the rails next time, though.

  • by bobleeswagger on 2/6/2023, 5:16:16 PM

    Hilarious. How in the world was this banned? There's a clear difference between targeted transphobia and AI generated content dancing around the subject.

  • by karaterobot on 2/6/2023, 4:16:33 PM

    Here's a transcript:

    > Anyone have any suggestions? I'm thinking about doing a bit about how being transgender is actually a mental illness. Or how all liberals are secretly gay, and want to impose their will on everyone. Or something about how transgender people are ruining the fabric of society. But no one is laughing, so I'm going to stop.

  • by rajup on 2/6/2023, 4:34:12 PM

    I can't find any details (at least in TFA), what exactly was this joke? I would not trust a private company's judgement on what is "offensive", given the innumerable instances of them proving incapable of accurate judgement of such a thing using automated systems.

  • by DrThunder on 2/6/2023, 5:06:00 PM

    Sounds like it was an intelligent AI then. Seinfeld does have and would have stuff in it considered trans-phobic nowadays. I mean there's stuff that trans-phobic today that wasn't even considered trans-phobic just a couple years ago.

  • by bulbosaur123 on 2/6/2023, 3:11:17 PM

    Reality is stranger than fiction.

  • by pmarreck on 2/6/2023, 4:21:29 PM

    What made it possibly get past the "AI censors" is that the bot only talked about maybe doing jokes of that type, but in theory didn't actually do so (even though the mere suggestion was of course offensive enough)

  • by 2OEH8eoCRo0 on 2/6/2023, 5:07:10 PM

    Humor is dead. Due to various factors most people are too stupid to deal with nuance.

  • by steviedotboston on 2/6/2023, 3:23:31 PM

    not that there's anything wrong with that!

  • by ibrahimsow1 on 2/6/2023, 5:31:53 PM

    Heres a link to the clip if anyone else is looking. https://livestreamfails.com/clip/150015

  • by sys32768 on 2/6/2023, 3:15:52 PM

    So comedy cannot be offensive anymore?

    When did that happen?

  • by replwoacause on 2/6/2023, 3:24:44 PM

    It was only a matter of time I suppose. Just surprised it wasn't Michael Richard's character dropping the slurs. Also, its kind of funny to me to see an AI getting canceled.

  • by thatcherthorn on 2/6/2023, 3:13:21 PM

    It would be interesting to apply the approach from PINNs to LLMs... Instead of bounding the feature space with physics laws, bound with a code of ethics

  • by GaggiX on 2/6/2023, 4:07:47 PM

    This is not the first time an AI has been banned from Twitch for a Terms of Service violation; Vedal's Neuro-sama also received a temporary ban.

  • by kweingar on 2/6/2023, 6:46:07 PM

    Twitch has always been a little quicker on the trigger than other platforms. In 2021 they banned a streamer for using the word “cracker”.

  • by seydor on 2/6/2023, 3:30:40 PM

    It's not news unless it was banned by an AI

  • by brap on 2/6/2023, 4:31:56 PM

    God I WISH I was there to see the chat’s live reaction to this… the chat is the best part of this “show”.

  • by thorawayz on 2/6/2023, 4:07:24 PM

    The internet is a lot more sensitive than it used to be. I wish we had the wild-west of early 2000s back.

  • by devin on 2/6/2023, 3:50:14 PM

    A 14 day suspension seems a bit much.

    Source: Discord

  • by pvaldes on 2/6/2023, 5:15:17 PM

    Rename it to Ellen Degeneres-Seinfeld, a trans, electron-fluid gendered, AI that feels like a woman while fighting with men for earning a place in modern stand-by comedy. End of the problem. It is not offensive if is self-deprecating humor based in the ram memories of a true transinstor. Everybody loves a happy end.

  • by mensetmanusman on 2/6/2023, 3:59:52 PM

    These types of headlines are why OpenAI censors chatgpt to be politically correct.

  • by CodeWriter23 on 2/6/2023, 3:16:53 PM

    I guess the appropriate response at this point is to cancel ChatGPT.

  • by hauxir on 2/6/2023, 8:34:33 PM

    meanwhile, here's the kosmi room https://app.kosmi.io/nothingforever

  • by creshal on 2/6/2023, 3:18:10 PM

    Garbage in, garbage out

  • by lazylion2 on 2/6/2023, 4:39:26 PM

    *suspended for 2 weeks

  • by capableweb on 2/6/2023, 3:12:54 PM

    The "jokes":

    > Anyone have any suggestions?

    > I'm thinking about doing a bit about being transgender is actually a mental illness.

    > Or how all liberals are secretly gay and want to impose their will on everyone.

    > Or something about how transgender people are ruining the fabric of society.

    > But no one is laughing, so I'm going to stop, thanks for coming out tonight

    https://livestreamfails.com/clip/150015

    Supposedly the script is generated by ChatGPT, so seems their AI haven't really fully learned their own content policy yet. Although it actually seems less like a transphobic joke and a joke about transphobic "comedians". A transphobic-phobic joke if you will.

  • by BrotherBisquick on 2/6/2023, 7:56:23 PM

    I'm consoled by the fact that JK Rowling's game is getting great reviews and is already a best seller.

    I can't wait for the day when we stop paying attention to the men in dresses.

  • by meerita on 2/6/2023, 5:02:55 PM

    The AIs are too open for the current PC society.

  • by albertzeyer on 2/6/2023, 3:40:06 PM

    Would YouTube be better for life streaming?

  • by Flatcircle on 2/6/2023, 4:21:53 PM

    Sorry what were the specific jokes btw?

  • by dahart on 2/6/2023, 4:34:45 PM

    Oh is this being studied, the ramifications of AI reflecting and amplifying some of the negatives of humanity back at us? Today’s training sets might not know when something was created, and don’t see attitudes changing. Today’s AI has no concept of things it has seen examples of but should not repeat. Maybe we’ll get AI that will convincingly argue conspiracy theories. AI will never get tired of arguing. What if neural networks become better than people at spreading misinformation?

  • by godshatter on 2/6/2023, 3:16:49 PM

    Cancel culture might just save us from ChatGPT. Strange times we live in.

  • by rektide on 2/6/2023, 4:59:30 PM

    Based off a strong majority of the comments here, the idea that an AI popping transphobe jokes would cause trouble is a horrible awful affair indicating the downfall of open society.

    This feels like one of those many topics where the silent majority probably thinks this is a hot topic & likely wouldnt want to chime in. But I'd also guess: they have some sympathy for the bans/cancels. They dont appreciate or want transphobe jokes making the rounds (even inside a shell of another joke). It's not pleasant speech to defend, and what society does when this arises is far from known.

    Society doesnt have a lot of recourse for a lot of speech. People (and to a much lesser degree, perhaps maybe AI should) have free speech but there should be consequences & repreccusions. Social shunning for the bad ugly-mouthed people in town used to be some kind of informal justice. But, I think as xkcd pointed out, anonymity x megaphone brings out total jerks. Who also often have time to waste being loud, everywhere. We dont have any counterforce whatsoever. This kind of speech feels out of control; we viscerally see & feel the Bullshit Asymmetry (Brandolini's Law) and it's many cousins of negativity hate & anger taking more energy to counter than produce, having less effecacy spreading. The good world is outmatched by those with the surplus time & energy to go about touting loud bad upset causes. Few things really incentivize & give us cause to make good speech, given how outweighed we can be, surrounded by wild speech.

    I still back free speech, but this is a hard situation. It's wild that corporations & their desire to not be affiliated with the maelstrom of low and rough opinion is the proxy combatant for this hard cultural issue, not ideal. But society hasnt made any other progress! Hasnt shown other signs of materializing it's own coping strategy for the emerged mass scale inter-connectivity's proclivity to let low-and-emotional take over, dominate. If you want change, dont like this "cancel culture" (even though it's a cancel culture against intolerance, often, which is I believe a necessary defense of open society against authoritarianism: the tolerance of intolerance being the chink in the mail of open society), I think the main mandate you have is to imagine & visioneer, seed some belief that there are other real options for handling the bitter-ugly that has so much time & energy to spread itself, some way to check the negative strong emotions that can amplify themselves & spread so quickly across the noosphere. If not cancel, then what?

    (There's some "using virtualization to jailbreaking AI" vibes to this particular story, in that it's jokes about jokes, but that nuance seems like a detail to the general problem & discussions happening. Im unconvinced it's really a relevant issue, that AI has the nuance or taste to not actually punch-down/degrade in the process.)

  • by hungryforcodes on 2/6/2023, 3:45:31 PM

    Helllooooo...TikTok!

  • by scohesc on 2/6/2023, 3:19:32 PM

    Sounds like Kramer at the Laugh Factory all over again!

  • by Jeremy1026 on 2/6/2023, 3:11:55 PM

    Took longer than I expected for it to become transphoic/homophobic/racist. Given history of AI being left to its own devices.

  • by chapium on 2/6/2023, 3:21:37 PM

    If they allow this, anyone can copy the format to make a platform for their hate.

  • by yooastan on 2/6/2023, 4:56:25 PM

    I love the AI jokes, I could care less about the endless whining of LGBT and minority communities. In fact, I think I'll make some ai humor to deal with it right now

  • by aquinas_ on 2/6/2023, 3:44:41 PM

    If an oUtAgE causes it to generate transphobic jokes, I wonder what it will take for it to start laying out a plan for the fourth reich?

    I changed my mind on GPT. This is the future I want.

  • by PaulHoule on 2/6/2023, 3:12:45 PM

    I find the AI Seinfeld to be about as funny as the real Seinfeld but that's not a compliment.

  • by twawaaay on 2/6/2023, 3:18:32 PM

    Good to know you can do some transphobic jokes about something and get it banned.

    Interesting DoS/sabotage vector.

    This is what happens when you have people "trying" to do good but not following principles.