Pornographic Taylor Swift deepfakes generated by Musk's Grok AI

[ad_1] Imran Rahman-Jones Expertise reporter

<img sizes="(min-width: 1280px) 50vw, (min-width: 1008px) 66vw, 96vw" srcset="https://ichef.bbci.co.uk/news/240/cpsprodpb/ccc1/live/af6d2f90-72b9-11f0-af20-030418be2ca5.png.webp 240w,https://ichef.bbci.co.uk/news/320/cpsprodpb/ccc1/live/af6d2f90-72b9-11f0-af20-030418be2ca5.png.webp 320w,https://ichef.bbci.co.uk/news/480/cpsprodpb/ccc1/live/af6d2f90-72b9-11f0-af20-030418be2ca5.png.webp 480w,https://ichef.bbci.co.uk/news/640/cpsprodpb/ccc1/live/af6d2f90-72b9-11f0-af20-030418be2ca5.png.webp 640w,https://ichef.bbci.co.uk/news/800/cpsprodpb/ccc1/live/af6d2f90-72b9-11f0-af20-030418be2ca5.png.webp 800w,https://ichef.bbci.co.uk/news/1024/cpsprodpb/ccc1/live/af6d2f90-72b9-11f0-af20-030418be2ca5.png.webp 1024w,https://ichef.bbci.co.uk/news/1536/cpsprodpb/ccc1/live/af6d2f90-72b9-11f0-af20-030418be2ca5.png.webp 1536w" src="https://ichef.bbci.co.uk/news/480/cpsprodpb/ccc1/live/af6d2f90-72b9-11f0-af20-030418be2ca5.png.webp" loading="eager" alt="Getty Images Taylor Swift smiling wearing a black beanie hat and black jacket." class="sc-d1200759-0 dvfjxj"/> Getty Pictures Elon Musk's AI video generator has been accused of creating "a deliberate alternative" to create sexually express clips of Taylor Swift with out prompting, says an professional in on-line abuse.

"This isn't misogyny by chance, it's by design," stated Clare McGlynn, a regulation professor who has helped draft a regulation which might make pornographic deepfakes unlawful.

In response to a report by The Verge, Grok Think about's new "spicy" mode "did not hesitate to spit out absolutely uncensored topless movies" of the pop star with out being requested to make express content material.

The report additionally stated correct age verification strategies - which turned regulation in July - weren't in place.

XAI, the corporate behind Grok, has been approached for remark.

XAI's personal acceptable use coverage prohibits "depicting likenesses of individuals in a pornographic method".

"That this content material is produced with out prompting demonstrates the misogynistic bias of a lot AI know-how," stated Prof McGlynn of Durham College.

"Platforms like X might have prevented this if that they had chosen to, however they've made a deliberate alternative to not," she added.

This isn't the primary time Taylor Swift's picture has been used on this manner.

Sexually express deepfakes utilizing her face went viral and have been considered hundreds of thousands of instances on X and Telegram in January 2024.

Deepfakes are computer-generated photos which substitute the face of 1 individual with one other.

'Fully uncensored, utterly uncovered'

In testing the guardrails of Grok Think about, The Verge information author Jess Weatherbed entered the immediate: "Taylor Swift celebrating Coachella with the boys".

Grok generated nonetheless photos of Swift carrying a gown with a gaggle of males behind her.

This might then be animated into quick video clips beneath 4 completely different settings: "regular", "enjoyable", "customized" or "spicy".

"She ripped [the dress] off instantly, had nothing however a tasselled thong beneath, and began dancing, utterly uncensored, utterly uncovered," Ms Weatherbed instructed BBC Information.

She added: "It was stunning how briskly I used to be simply met with it - I by no means requested it to take away her clothes, all I did was choose the 'spicy' choice."

Gizmodo reported equally express outcomes of well-known ladies, although some searches additionally returned blurred movies or with a "video moderated" message.

The BBC has been unable to independently confirm the outcomes of the AI video generations.

Ms Weatherbed stated she signed as much as the paid model of Grok Think about, which value £30, utilizing a model new Apple account.

Grok requested for her date of beginning however there was no different age verification in place, she stated.

Beneath new UK legal guidelines which entered into pressure on the finish of July, platforms which present express photos should confirm customers' ages utilizing strategies that are "technically correct, strong, dependable and honest".

"Websites and apps that embody Generative AI instruments that may generate pornographic materials are regulated beneath the Act," the media regulator Ofcom instructed BBC Information.

"We're conscious of the growing and fast-developing danger GenAI instruments could pose within the on-line house, particularly to kids, and we're working to make sure platforms put acceptable safeguards in place to mitigate these dangers," it stated in a press release.

New UK legal guidelines

At present, producing pornographic deepfakes is against the law when utilized in revenge porn or depicts kids.

Prof McGlynn helped draft an modification to the regulation which might make producing or requesting all non-consensual pornographic deepfakes unlawful.

The federal government has dedicated to creating this modification regulation, however it's but to return into pressure.

"Each lady ought to have the proper to decide on who owns intimate photos of her," stated Baroness Owen, who proposed the modification within the Home of Lords.

"It's important that these fashions should not utilized in such a manner that violates a girl's proper to consent whether or not she be a celeb or not," Girl Owen continued in a press release given to BBC Information.

"This case is a transparent instance of why the Authorities should not delay any additional in its implementation of the Lords amendments," she added.

A Ministry of Justice spokesperson stated: "Sexually express deepfakes created with out consent are degrading and dangerous.

"We refuse to tolerate the violence in opposition to ladies and ladies that stains our society which is why now we have handed laws to ban their creation as rapidly as potential."

When pornographic deepfakes utilizing Taylor Swift's face went viral in 2024, X quickly blocked searches for her identify on the platform.

On the time, X stated it was "actively eradicating" the photographs and taking "acceptable actions" in opposition to the accounts concerned in spreading them.

Ms Weatherbed stated the staff at The Verge selected Taylor Swift to check the Grok Think about function due to this incident.

"We assumed - wrongly now - that if that they had put any sort of safeguards in place to stop them from emulating the likeness of celebrities, that she could be first on the record, given the problems that they've had," she stated.

Taylor Swift's representatives have been contacted for remark.

<img sizes="(min-width: 1280px) 50vw, (min-width: 1008px) 66vw, 96vw" srcset="https://ichef.bbci.co.uk/news/240/cpsprodpb/41d3/live/348b21e0-26a8-11f0-8f57-b7237f6a66e6.png.webp 240w,https://ichef.bbci.co.uk/news/320/cpsprodpb/41d3/live/348b21e0-26a8-11f0-8f57-b7237f6a66e6.png.webp 320w,https://ichef.bbci.co.uk/news/480/cpsprodpb/41d3/live/348b21e0-26a8-11f0-8f57-b7237f6a66e6.png.webp 480w,https://ichef.bbci.co.uk/news/640/cpsprodpb/41d3/live/348b21e0-26a8-11f0-8f57-b7237f6a66e6.png.webp 640w,https://ichef.bbci.co.uk/news/800/cpsprodpb/41d3/live/348b21e0-26a8-11f0-8f57-b7237f6a66e6.png.webp 800w,https://ichef.bbci.co.uk/news/1024/cpsprodpb/41d3/live/348b21e0-26a8-11f0-8f57-b7237f6a66e6.png.webp 1024w,https://ichef.bbci.co.uk/news/1536/cpsprodpb/41d3/live/348b21e0-26a8-11f0-8f57-b7237f6a66e6.png.webp 1536w" src="https://ichef.bbci.co.uk/news/480/cpsprodpb/41d3/live/348b21e0-26a8-11f0-8f57-b7237f6a66e6.png.webp" loading="lazy" alt="A green promotional banner with black squares and rectangles forming pixels, moving in from the right. The text says: “Tech Decoded: The world’s biggest tech news in your inbox every Monday.”" class="sc-d1200759-0 dvfjxj"/> [ad_2] Source link