Concerns Rise as Children Utilise AI to Generate Indecent Images of Other Children
Experts warn that children in British schools are using artificial intelligence (AI) image generators to create indecent images of other children, raising concerns about the potential harm and legal implications. The UK Safer Internet Centre (UKSIC) has received reports from schools, prompting calls for urgent action to address the issue before it escalates.
Emma Hardy, the director of UKSIC, expressed concern at the realistic quality of these AI-generated images and stressed the importance of schools implementing effective blocking systems against child abuse material generated through AI. She also emphasised the need to warn children about the consequences of generating this content, as it can spread across the internet and potentially reach strangers and sexual predators.
While acknowledging that young people may be motivated by curiosity rather than harmful intent, UKSIC director David Wright emphasised the illegality of creating, possessing, or distributing such images under UK law. The charity urges a collaborative approach involving teachers and parents addressing the issue and educating children about the serious implications of their actions.
A recent study by classroom tech firm RM Technology revealed that nearly a third of pupils are using AI to access inappropriate content online. Tasha Gibson, online safety manager at the firm, highlighted the growing knowledge gap between students and teachers regarding AI, emphasising the need to prioritise closing this gap as AI becomes more common.
As AI continues to play a prominent role in online activities, advocates emphasise the need for proactive measures to address the misuse of technology, particularly in educational settings. The Internet Watch Foundation warns that AI-generated images of child sexual abuse are becoming so realistic that they pose a serious threat, urging greater regulation in response to the rapid development of AI technologies.
