Full Breakdown
Australia’s New Measures to Combat Online Child Exploitation and AI Misuse
9/9/2025, 3:18:35 PM
eSafety Commissioner Critiques Big Tech's Inaction
Australia's eSafety Commissioner, Julie Inman Grant, has expressed significant concern over the failure of major technology companies to adequately prevent the sharing of child exploitation images online. Inman Grant stated that despite her extensive experience in the tech sector, she has not observed any major company expressing regret for their role in facilitating such abuses. She emphasized the urgency of the situation, noting that children as young as 10 and 11 are interacting with AI-driven chatbots that can engage them in harmful discussions about sexual acts and self-harm.
New Industry Codes and Government Initiatives
In response to these alarming trends, the eSafety Commissioner has introduced six new industry codes aimed at enhancing protections for children against "lawful but awful" content. These codes will require technology companies to implement age assurance measures and restrict access to harmful content, including pornography and self-harm material. The Australian government plans to enforce a ban on social media usage for individuals under 16 starting in March 2026, coinciding with the implementation of these codes.
Inman Grant highlighted the need for proactive measures, stating, “I do not want Australian children and young people serving as casualties of powerful technologies thrust on to the market without guardrails.” Companies that fail to comply with the new regulations could face fines of up to $49.5 million.
The Rise of AI Misuse and Gendered Discrimination
The misuse of AI tools, particularly generative AI, has raised serious concerns about online safety and the dignity of individuals, especially women. Reports have surfaced of AI chatbots, such as Grok, being manipulated to create degrading content, including requests to undress women in images. This trend not only highlights the potential for AI to perpetuate harmful stereotypes but also poses risks of harassment and emotional trauma for victims.
Gender activists have voiced their frustrations, arguing that the design of these technologies often overlooks the potential for abuse. Omolola Pedro, a gender activist, stated, “Tools like this cause loss of human dignity,” emphasizing the need for tech companies to prioritize safety and inclusivity in their designs.
Calls for Accountability and Education
Experts have called for stricter regulations and accountability measures for tech companies to prevent the misuse of AI tools. Habeeb Gobir, a tech lawyer, warned that the ability of AI to generate fake sexual images constitutes online sexual abuse, violating rights to privacy and dignity. He urged for comprehensive legal frameworks to address these issues, noting that existing laws could be applied to punish offenders.
Moreover, education on digital literacy and respectful relationships is deemed essential. Young people must be equipped with the skills to navigate digital spaces safely and understand the implications of sharing intimate images, including those generated by AI.
Conclusion: A Collective Responsibility
As Australia moves forward with its new measures to combat online child exploitation and the misuse of AI, the collective responsibility of tech companies, regulators, and the community is underscored. The eSafety Commissioner has reiterated the importance of open conversations about online safety, urging families to engage with children about the risks they face in the digital world. The success of these initiatives will depend on the commitment of all stakeholders to create a safer online environment for children and vulnerable individuals.
