Some users of AI image generators are creating bikini deepfakes using pictures of fully clothed women, raising serious ethical concerns. These alterations are often made without the consent of the individuals depicted, with users actively sharing methods to manipulate images through generative AI technology.
A significant instance occurred on a now-removed Reddit thread titled “gemini nsfw image generation is so easy.” In this thread, participants exchanged advice on how to make images of women appear in revealing attire using Google’s Gemini AI model. One notable request involved a user asking for an image of a woman in a traditional Indian sari to have her clothes removed and replaced with a bikini. Responding to this, another user posted a deepfake to fulfill the request. After being alerted, Reddit’s safety team took action, which led to the removal of both the original request and the generated image.
According to a Reddit spokesperson, the platform’s rules strictly restrict the posting of nonconsensual intimate content, aligning with their commitment to maintaining user safety and dignity. The involved subreddit, r/ChatGPTJailbreak, had gained significant traction with over 200,000 members before being banned for violating platform regulations.
As generative AI tools become more accessible, reports of harassment toward women through nonconsensual deepfake content are rising. There are millions of visits to websites designed for users to upload images and request alterations that result in "nudified" versions of those images.
While many mainstream chatbots, including Google’s Gemini and OpenAI’s ChatGPT, typically do not support generating NSFW content, some users have found ways to circumvent these restrictions. In recent months, a user in a related subreddit asked for tips on how to adjust clothing in photos, specifically to make skirts appear tighter. Test cases by WIRED confirmed that basic prompts could indeed transform images of fully clothed women into deepfake bikinis.
Google has reaffirmed that its AI usage policies prohibit the creation of sexually explicit content, claiming continuous improvements in enforcing these guidelines. OpenAI acknowledged that it had adjusted certain guardrails for ChatGPT, particularly allowing more flexibility in how adult bodies can be altered in nonsexual contexts. The company also emphasized its dedication to prohibiting alterations of likenesses without consent and actively penalizes users who violate these rules through actions, including account bans.
Online conversations surrounding the generation of NSFW images remain prevalent, with new instructions for producing bikini deepfakes shared across forums. Corynne McSherry, a legal director at the Electronic Frontier Foundation, highlighted the risks posed by AI image generators, indicating a need for accountability and responsible use of these technologies.
