Malaysia, Indonesia turn into first to dam Musk’s Grok over AI deepfakes : NPR

[ad_1] <img src="https://npr.brightspotcdn.com/dims3/default/strip/false/crop/6000x4000+0+0/resize/1100/quality/50/format/jpeg/?url=http%3A%2F%2Fnpr-brightspot.s3.amazonaws.com%2F68%2F36%2F331971e14d24ab32a7c89bc1ba18%2Fap26012168381117.jpg" data-template="https://npr.brightspotcdn.com/dims3/default/strip/false/crop/6000x4000+0+0/resize/{width}/quality/{quality}/format/{format}/?url=http%3A%2F%2Fnpr-brightspot.s3.amazonaws.com%2F68%2F36%2F331971e14d24ab32a7c89bc1ba18%2Fap26012168381117.jpg" class="img" alt="FILE - Elon Musk listens as President Donald Trump speaks during a news conference in the Oval Office of the White House, May 30, 2025, in Washington. " fetchpriority="high"/> FILE - Elon Musk listens as President Donald Trump speaks throughout a information convention within the Oval Workplace of the White Home, Might 30, 2025, in Washington. Evan Vucci/AP cover caption

toggle caption

Evan Vucci/AP KUALA LUMPUR, Malaysia — Malaysia and Indonesia have turn into the primary international locations to dam Grok, the unreal intelligence chatbot developed by Elon Musk's xAI, after authorities stated it was being misused to generate sexually specific and non-consensual photographs.

The strikes mirror rising world concern over generative AI instruments that may produce reasonable photographs, sound and textual content, whereas current safeguards fail to stop their abuse. The Grok chatbot, which is accessed by way of Musk's social media platform X, has been criticized for producing manipulated photographs, together with depictions of ladies in bikinis or sexually specific poses, in addition to photographs involving youngsters.

Regulators within the two Southeast Asian nations stated current controls weren't stopping the creation and unfold of pretend pornographic content material, significantly involving ladies and minors. Indonesia's authorities quickly blocked entry to Grok on Saturday, adopted by Malaysia on Sunday.

"The federal government sees non-consensual sexual deepfakes as a critical violation of human rights, dignity and the protection of residents within the digital area," Indonesia's Communication and Digital Affairs Minister Meutya Hafid stated in a press release Saturday.

The ministry stated the measure was meant to guard ladies, youngsters and the broader group from faux pornographic content material generated utilizing AI.

Preliminary findings confirmed that Grok lacks efficient safeguards to cease customers from creating and distributing pornographic content material based mostly on actual photographs of Indonesian residents, Alexander Sabar, director basic of digital area supervision, stated in a separate assertion. He stated such practices threat violating privateness and picture rights when photographs are manipulated or shared with out consent, inflicting psychological, social and reputational hurt.

In Kuala Lumpur, the Malaysian Communications and Multimedia Fee ordered a short lived restriction on Grok on Sunday after what it stated was "repeated misuse" of the device to generate obscene, sexually specific and non-consensual manipulated photographs, together with content material involving ladies and minors.

The regulator stated notices issued this month to X Corp. and xAI demanding stronger safeguards drew responses that relied primarily on person reporting mechanisms.

"The restriction is imposed as a preventive and proportionate measure whereas authorized and regulatory processes are ongoing," it stated, including that entry will stay blocked till efficient safeguards are put in place.

Launched in 2023, Grok is free to make use of on X. Customers can ask it questions on the social media platform and tag posts they've immediately created or replies to posts from different customers. Final summer season the corporate added a picture generator characteristic, Grok Think about, that included a so-called "spicy mode" that may generate grownup content material.

The Southeast Asian restrictions come amid mounting scrutiny of Grok elsewhere, together with within the European Union, Britain, India and France. Grok final week restricted picture era and modifying to paying customers following a world backlash over sexualized deepfakes of individuals, however critics say it didn't absolutely deal with the issue.