The growth of generative AI pornography has also attracted some cause for criticism. AI technology can be exploited to create
non-consensual pornographic material, posing risks similar to those seen with deepfake
revenge porn and AI-generated NCII (Non-Consensual Intimate Image). A 2023 analysis found that 98% of deepfake videos online are pornographic, with 99% of the victims being women.
OpenAI is exploring whether
NSFW content, such as
erotica, can be responsibly generated in age-appropriate contexts while maintaining its ban on deepfakes. This proposal has attracted criticism from child safety campaigners who argue it undermines OpenAI's mission to develop "safe and beneficial" AI.
AI-generated non-consensual intimate imagery (AI Undress) Generative AI have extensively been used to produce pornography images and videos of non-consenting individuals.
404 Media reported a particular AI generated porn bot on Telegram has more than 100,000 monthly users. Alibaba, the Chinese tech company, released an AI video generation model in 2025 called Wan 2.1, which was modified to produce non-consensual pornography. In 2024,
San Francisco filed a landmark lawsuit to shut down "undress" apps that allow users to generate non-consensual AI nude images, citing violations of state laws. The case aligns with
California's recent legislation—SB 926, SB 942, and SB 981—championed by Senators
Aisha Wahab and
Josh Becker and signed by
Governor Gavin Newsom. These bills aim to protect individuals from AI-generated explicit images by criminalizing non-consensual distribution, mandating disclosures, and empowering victims to report and remove harmful content from platforms.
Differences from deepfake pornography While both generative AI pornography and
deepfake pornography rely on
synthetic media, they differ in their methods and ethical considerations. In contrast, generative AI pornography is created using algorithms, producing hyper-realistic content without the need to upload real pictures of people.
Hany Farid,
digital image analysis expert, also described the difference between "AI porn" and "deepfake porn." ==Legality==