The report coincided with a wave of intense media scrutiny of AI-generated pornographic images of pop star Taylor Swift that spread across X (formerly Twitter), Instagram, and Facebook.
404 Media traced the sexually explicit AI-generated images of Swift back to 4chan and a Telegram channel that is “dedicated to making non-consensual AI generated sexual images of women.” Members of this group, they wrote, “generate similarly explicit images of dozens of female celebrities, not just Swift.” (Media Matters previously reported that users on 4chan have used Microsoft AI tools to develop and disseminate other disturbing or hateful images, including of Swift.)
The rising prevalence of AI-generated content across social media poses a number of challenges. AI researchers have observed that study participants tend to “overestimate” their own abilities to detect deepfaked audio and video. Meanwhile, developers of AI tools have admitted that, in some cases, they have difficulty discerning if a creator used their software to generate misleading media. Platforms have also struggled to consistently moderate misinformation in general, often allowing it to spread widely as users replicate and reshare the content across platforms.
On the 404 Media Podcast, Samantha Cole and Emanuel Maiberg noted that Taylor Swift’s “visibility might help raise awareness” of the issue of AI tools being weaponized against people, and that such abuse “happens to minor celebrities, it happens to normal people, it happens to them every day — we talk to these people every day — and the White House does not mobilize itself for an Instagram influencer who was being deepfaked, or just a random person.”
As YouTube veteran Hank Green explained, “These models are just going to keep getting better,” and whatever “tricks” people are “using right now to figure out if an image is created by artificial intelligence, you will not be able to use those tricks in even one year.” He added, “We are not going to closely scrutinize each one of the hundreds of images that we come across every day.”