Rise in AI-Generated Deepfake Child Sexual Abuse Images in the UK

Report Remove, the service run by the Internet Watch Foundation (IWF) and the NSPCC, received 420 reports from children in the first half of this year that their likenesses had been turned into explicit images. That figure already surpasses the 397 reports logged for the entire previous year. Most of the submissions were judged severe enough to meet the legal definition of child sexual abuse material (CSAM). The IWF notes that the majority of these cases involved AI-generated or “nudified” images, a capability it warned could be exploited at scale.

The Guardian

The increase follows the wider availability of AI image generators and nudification tools that can manipulate benign photographs into sexualized depictions. The UK has criminalised the creation of AI-generated CSAM and the distribution of models designed for that purpose. Nonetheless, the ease of producing convincing deepfakes has outpaced existing safeguards, prompting safety watchdogs to flag the trend as “predictable” yet alarming.

The Guardian

“Everyone in the world is at risk,” — Dan Sexton, chief technology officer at the Internet Watch Foundation (IWF) He added that tech firms must embed stronger safeguards: “Tech companies cannot keep pushing out AI products without embedding strong protections that prevent this material from being created in the first place.” “Tech companies cannot keep pushing out AI products without embedding strong protections that prevent this material from being created in the first place.” — Dan Sexton, chief technology officer at the Internet Watch Foundation (IWF) Rani Govender, online-safety expert at the NSPCC, called for tighter safety measures within AI products to stop the creation of explicit material.

The Guardian

Some victims reported being targeted for sextortion, with blackmailers threatening to release the deepfaked images unless paid or forced to supply further explicit content. In response, Report Remove hashes flagged images and shares the fingerprints with major platforms to block re-uploads. The National Crime Agency and the IWF have urged parents to keep children’s photos private, limit public sharing, and remove identifiable images from school websites and social-media accounts.

The Guardian

Authorities continue to monitor the surge and are urging tech companies to adopt robust preventative controls. Ongoing guidance encourages families and schools to restrict the online visibility of children’s faces, aiming to reduce the raw material that AI systems can exploit.

The Guardian