Instagram has recently seen a surge in AI-generated influencers, utilizing stolen content from real adult performers and models to create profiles that monetize through various platforms like Patreon and OnlyFans. This phenomenon, dubbed “AI pimping,” has escalated to the point where genuine content creators find themselves competing against these AI accounts, often suffering a significant decline in their engagement.
The concept of AI influencers was first highlighted in April by 404 Media, revealing an alarming trend that appears to be expanding as Instagram struggles to manage the influx of this content or to protect those whose images are being exploited. Our examination of over 1,000 AI-generated Instagram accounts and associated Discord channels shows that the tools needed to create and monetize these accounts are increasingly accessible, with many available as apps on major platforms.
Elaina St James, an adult content creator who relies on Instagram for promotion, noted a dramatic decrease in her reach, attributed in part to the competition with these AI-generated profiles. She stated, “This is probably one of the reasons my views are going down… It’s because I’m competing with something that’s unnatural.” Her views have dropped from millions a month to significantly less than one million, with some months showing under 500,000 views.
Alexios Mantzarlis, a researcher at Cornell Tech, discovered nearly 900 AI influencer accounts while casually browsing Instagram. He emphasized that these accounts signal a looming shift in social media where AI-generated content may overtake human-generated posts. He foresees a troubling future for online engagement, where the line between real and artificial blurs further.
Among the accounts studied, around 100 employed deepfake technology to create new video content by replacing the faces of real performers with AI-generated ones. Some of these AI influencers even stated their virtual nature in their profiles, while others operated without such disclosures, effectively misleading users.
One prominent account, "Chloe Johnson," amassed roughly 171,000 followers before its recent deletion by Instagram. Investigations revealed that many of Johnson’s posts used videos of actual models without their consent. This practice of using face-swapping technology to produce content is a clear violation of the rights of original content creators, making the phenomenon of AI influencers deeply concerning.
These accounts don’t just exist in isolation; they thrive through various monetization strategies found in guides from those who have successfully navigated this new industry. For example, the “AI Influencer Accelerator” course teaches individuals how to generate income through AI influencers while highlighting how deepfake technology can be utilized effectively.
Platforms designed for adult content, such as Fanvue, have increasingly been linked with these AI influencers, further amplifying the financial implications of this AI-driven content creation. Reports indicate that several individuals have generated substantial incomes by employing fraudulent methods involving AI-generated content that lacks transparency.
St James expressed frustration at the situation, noting that the operators of these AI accounts often profit while real women, who already face systemic challenges in the industry, are marginalized. She emphasized a sentiment echoed by many in her field: that AI-generated accounts undermine the genuine work of human creators.
While some AI operator groups attempt to distinguish themselves from unethical practices by emphasizing transparency, the reality remains that many individuals exploit this technology without regard for the content owners’ rights. Authorities like Instagram have begun to respond to some extent by banning certain accounts, but the scale of the issue suggests a more systemic problem tied to the platform’s reliance on content engagement, making it challenging for it to act decisively against AI-generated content.
As social media continues to evolve, the implications of AI-generated influencers raise critical questions about authenticity, rights, and the future of content creation in a landscape that increasingly favors artificial over human expressions.
