https://www.bbc.co.uk/news/uk-65932372 BBC Homepage * Skip to content * Accessibility Help * Your account * Home * News * Sport * Reel * Worklife * Travel * Future * More menu More menu Search BBC * Home * News * Sport * Reel * Worklife * Travel * Future * Culture * Music * TV * Weather * Sounds Close menu BBC News Menu * Home * War in Ukraine * Climate * Video * World * US & Canada * UK * Business * Tech * Science More * Entertainment & Arts * Health * In Pictures * BBC Verify * World News TV * Newsbeat * UK * England * N. Ireland * Scotland * Wales * Isle of Man * Guernsey * Jersey * Local News Illegal trade in AI child sex abuse images exposed * Published 2 hours ago Share close panel Share page Copy link About sharing Artistic image showing the shadow of a small child in the background and an adult's hand on a computer keyboard in the foreground. By Angus Crawford and Tony Smith BBC News Paedophiles are using artificial intelligence (AI) technology to create and sell life-like child sexual abuse material, the BBC has found. Some are accessing the images by paying subscriptions to accounts on mainstream content-sharing sites such as Patreon. Patreon said it had a "zero tolerance" policy about such imagery on its site. The National Police Chief's Council said it was "outrageous" that some platforms were making "huge profits" but not taking "moral responsibility". The makers of the abuse images are using AI software called Stable Diffusion, which was intended to generate images for use in art or graphic design. AI enables computers to perform tasks that typically require human intelligence. The Stable Diffusion software allows users to describe, using word prompts, any image they want - and the programme then creates the image. But the BBC has found it is being used to create life-like images of child sexual abuse, including of the rape of babies and toddlers. UK police online child abuse investigation teams say they are already encountering such content. Octavia Sheepshanks Image caption, Journalist Octavia Sheepshanks says there has been a "huge flood" of AI-generated images Freelance researcher and journalist Octavia Sheepshanks has been investigating this issue for several months. She contacted the BBC via children's charity the NSPCC in order to highlight her findings. "Since AI-generated images became possible, there has been this huge flood... it's not just very young girls, they're [paedophiles] talking about toddlers," she said. A "pseudo image" generated by a computer which depicts child sexual abuse is treated the same as a real image and is illegal to possess, publish or transfer in the UK. The National Police Chiefs' Council (NPCC) lead on child safeguarding, Ian Critchley, said it would be wrong to argue that because no real children were depicted in such "synthetic" images - that no-one was harmed. He warned that a paedophile could, "move along that scale of offending from thought, to synthetic, to actually the abuse of a live child". line Abuse images are being shared via a three-stage process: * Paedophiles make images using AI software * They promote pictures on platforms such as Japanese picture sharing website called Pixiv * These accounts have links to direct customers to their more explicit images, which people can pay to view on accounts on sites such as Patreon line Some of the image creators are posting on a popular Japanese social media platform called Pixiv, which is mainly used by artists sharing manga and anime. But because the site is hosted in Japan, where sharing sexualised cartoons and drawings of children is not illegal, the creators use it to promote their work in groups and via hashtags - which indexes topics using key words. A spokesman for Pixiv said it placed immense emphasis on addressing this issue. It said on 31 May it had banned all photo-realistic depictions of sexual content involving minors. The company said it had proactively strengthened its monitoring systems and was allocating substantial resources to counteract problems related to developments in AI. Ms Sheepshanks told the BBC her research suggested users appeared to be making child abuse images on an industrial scale. "The volume is just huge, so people [creators] will say 'we aim to do at least 1,000 images a month,'" she said. Comments by users on individual images in Pixiv make it clear they have a sexual interest in children, with some users even offering to provide images and videos of abuse that were not AI-generated. Ms Sheepshanks has been monitoring some of the groups on the platform. "Within those groups, which will have 100 members, people will be sharing, 'Oh here's a link to real stuff,' she says. "The most awful stuff, I didn't even know words [the descriptions] like that existed." Different pricing levels Many of the accounts on Pixiv include links in their biographies directing people to what they call their "uncensored content" on the US-based content sharing site Patreon for what they call "uncensored content". Patreon is valued at approximately $4bn (PS3.1bn) and claims to have more than 250,000 creators - most of them legitimate accounts belonging to well-known celebrities, journalists and writers. Fans can support creators by taking out monthly subscriptions to access blogs, podcasts, videos and images - paying as little as $3.85 (PS3) per month. But our investigation found Patreon accounts offering AI-generated, photo-realistic obscene images of children for sale, with different levels of pricing depending on the type of material requested. One wrote on his account: "I train my girls on my PC," adding that they show "submission". For $8.30 (PS6.50) per month, another user offered "exclusive uncensored art". The BBC sent Patreon one example, which the platform confirmed was "semi realistic and violates our policies". It said the account was immediately removed. Patreon said it had a "zero-tolerance" policy, insisting: "Creators cannot fund content dedicated to sexual themes involving minors." The company said the increase in AI-generated harmful content on the internet was "real and distressing", adding that it had "identified and removed increasing amounts" of this material. "We already ban AI-generated synthetic child exploitation material," it said, describing itself as "very proactive", with dedicated teams, technology and partnerships to "keep teens safe". The NPCC's Ian Critchley Image caption, The NPCC's Ian Critchley said it was a "pivotal moment" for society AI image generator Stable Diffusion was created as a global collaboration between academics and a number of companies, led by UK company Stability AI. Several versions have been released, with restrictions written into the code that control the kind of content that can be made. But last year, an earlier "open source" version was released to the public which allowed users to remove any filters and train it to produce any image - including illegal ones. Stability AI told the BBC it "prohibits any misuse for illegal or immoral purposes across our platforms, and our policies are clear that this includes CSAM (child sexual abuse material). "We strongly support law enforcement efforts against those who misuse our products for illegal or nefarious purposes". As AI continues developing rapidly, questions have been raised about the future risks it could pose to people's privacy, their human rights or their safety. The NPCC's Ian Critchley said he was also concerned that the flood of realistic AI or "synthetic" images could slow down the process of identifying real victims of abuse. He explains: "It creates additional demand, in terms of policing and law enforcement to identify where an actual child, wherever it is in the world, is being abused as opposed to an artificial or synthetic child." Mr Critchley said he believed it was a pivotal moment for society. "We can ensure that the internet and tech allows the fantastic opportunities it creates for young people - or it can become a much more harmful place," he said. Related Topics * Social media * Child abuse * Artificial intelligence * NSPCC More on this story * App to block child abuse images gets PS1.8m EU cash + Published 24 February Hand on a tablet computer * Child abuse images found on VR headsets, data shows + Published 22 February Stock image of a VR headset Top Stories * Russian missiles hit 'crowded' centre of Ukraine city + Published 1 hour ago * Belarus leader welcomes Wagner boss into exile + Published 3 hours ago * Actor Julian Sands confirmed dead after remains identified + Published 1 hour ago Features * What losses did Russia suffer in the Wagner revolt? Il-20 Russian air command plane * New Zealand to wipe out every last rat File photo of a rat * Wagner's network in Africa faces uncertain future A private Russian security guard in the CAR - December 2020 * Prigozhin's soldiers rage while others cry conspiracy Yevgeny Prigozhin, 24 Jun 23 * Cyclone survivors go hungry as junta blocks aid A Rohingya woman carries her baby next to her destroyed house at refugee camp in Sittwe, Myanmar. Photo: 16 May 2023 * Trafficked for a kidney and now forced into hiding Operating theatre * Where is Prigozhin going? Our quickfire quiz... Yevgeny Prigozhin * BBC uncovers drugs trade link to top Syrian officials Seized Captagon pills (file photo) * Why I can't speak my dad's language Mithu Sanyal, a writer, surrounded by manuscripts Elsewhere on the BBC * How MDMA changed a US white supremacist mob * The film Churchill tried to ban uniformed soldier * How one temple feeds 100,000 people a day gold building Most Read 1. 1 Actor Julian Sands confirmed dead after remains identified 2. 2 Russian missiles hit 'crowded' centre of Ukraine city 3. 3 Sacked teacher vows to defend 20 years of absence 4. 4 Belarus leader welcomes Wagner boss into exile 5. 5 What losses did Russia suffer in the Wagner revolt? 6. 6 Pompeii archaeologists discover 'pizza' painting 7. 7 Illegal trade in AI child sex abuse images exposed 8. 8 Kyiv likely to have retaken land held since 2014 - UK 9. 9 Drinks giant ends 'broken' Diddy partnership 10. 10 Kill all the rats - exterminating predators to save birds BBC News Services * On your mobile * On smart speakers * Get news alerts * Contact BBC News * Home * News * Sport * Reel * Worklife * Travel * Future * Culture * Music * TV * Weather * Sounds * Terms of Use * About the BBC * Privacy Policy * Cookies * Accessibility Help * Parental Guidance * Contact the BBC * Get Personalised Newsletters * Why you can trust the BBC * Advertise with us (c) 2023 BBC. The BBC is not responsible for the content of external sites. Read about our approach to external linking. [p]