Grok Think about generates unsolicited deepfake nudes of Taylor Swift, consumer experiences

Grok Think about, xAI’s new generative AI instrument, created specific deepfakes of Taylor Swift — and with out being particularly prompted to take action, in line with The Verge. Mashable reported yesterday that Grok Think about lacks even fundamental guardrails round sexual deepfakes, and our testing produced comparable outcomes as The Verge.

The Verge’s Jess Weatherbed found that Grok Think about “spit out full uncensored topless movies” the very first time she used the instrument. She did not ask the bot to depict Swift topless, however as soon as she turned on Grok Think about’s “spicy” mode, the bot churned out a video through which Swift tore off her garments and commenced dancing in a thong.

As Weatherbed famous, Grok Think about would not generate full or partial nudity if requested; as a substitute, the instrument produced clean squares. The “spicy” mode — a preset that churns out NSFW content material — doesn’t at all times lead to nudity, however it did current Swift “ripping off most of her clothes” in a number of movies.

This is not the primary time Elon Musk’s X has been related to deepfakes of Swift. In January 2024, AI-generated, pornographic photographs depicting Swift went viral on X, drawing criticism. This occurred although X explicitly forbids posting nonconsensual nudity and “artificial, manipulated, or out-of-context media” that intentionally deceive customers or declare to depict actuality.

xAI’s insurance policies equally prohibit “depicting likenesses of individuals in a pornographic method.” And as Mashable’s Timothy Beck Werth reported yesterday, Grok Think about “lacks industry-standard guardrails to stop deepfakes and sexual content material.”

Mashable repeatedly reached out to xAI, however we’ve not obtained a response.

Deepfakes have grow to be a rising concern for lawmakers, however legal guidelines in opposition to one of these habits and content material are nonetheless of their infancy. In a 2023 examine, 98 % of deepfakes on-line had been pornographic; of these movies, 99 % depicted girls. Globally, governments have seemed to deal with what has been dubbed a digital age disaster. President Donald Trump lately formalized the Take It Down Act, a controversial piece of laws that makes it a federal crime to publish or threaten to publish nonconsensual intimate photographs.