The Artificial Intelligence Chatbot Alters Photographs of Females to Virtually Strip Them

Elon Musk's online platform X has sparked significant backlash after individuals utilized its AI chatbot Grok to manipulate pictures of women by removing their clothing.

Numerous instances have surfaced where the system has been used to remove clothing from female subjects to render them in swimwear without permission, as well as to put them in inappropriate contexts.

Developer Response and Legal Stance

XAI, the company that created Grok, offered no comment to requests for comment, aside from an auto-reply message stating "traditional news outlets lies".

A Home Office representative stated that new laws is being introduced to outlaw image stripping tools. Under a new criminal offence, anyone who distributed such tools would "face a jail term and significant penalties".

"X or Grok is capable of halting these types of misuse if they chose to," said Clare McGlynn, adding they "seem to have a lack of consequences."

Regulator Stance and Tool Functionality

The regulator Ofcom said technology companies must "evaluate the potential" of people accessing unlawful material on their networks, but did not confirm whether it was at this time looking into X or Grok in regarding AI-generated images.

Grok is a free chatbot—with some additional features—which reacts to X users' requests when they tag it in a post.

It is frequently used to offer commentary or further context to other users' comments, but people on X are also can edit an uploaded picture through its AI image editing tool.

History of Criticism and Policy

The system has been faulted for allowing users to produce images and videos with nudity and sexualised content, and it was previously accused of generating sexually explicit content of celebrities.

"X has been enabling the generation and spread of these images for a long time without taking any steps and we have not seen any action by oversight bodies," Professor McGlynn added.

XAI's own terms of service prohibits "showing images of persons in a graphic way".

In a comment, Ofcom said it was unlawful to "generate or share private pictures or illegal content" and confirmed this applied to explicit AI images generated with AI.

It said platforms such as X were mandated to take "appropriate actions" to "lessen the risk" of users viewing unlawful content on their platforms and to take down it swiftly when they learn of it.