Digital Public Shaming: The Rise of Deepfake Technology in China

Chinese artificial intelligence tools, particularly the chatbot Doubao, have faced significant criticism for enabling the creation of non-consensual pornographic deepfake images, which critics describe as a form of "digital public shaming" targeting women. This issue has gained attention following a report by the feminist media collective Free Nora, which highlighted the exploitation of Doubao by internet users to generate these harmful images.

South China Morning Post

Doubao, developed by the tech giant ByteDance, is currently the leading AI chatbot in China, boasting 155 million weekly active users as of late December, according to data from mobile internet information provider QuestMobile. The platform has become a tool for generating deepfake content, contributing to a disturbing trend of digital harassment against women. While the global community has begun to address the risks associated with AI deepfakes through regulatory measures, China has yet to implement effective regulations to combat this issue.

South China Morning Post

Free Nora's report emphasizes the psychological impact on women, stating, "For many women, a face they once believed to be uniquely their own has become raw material in a digital landscape where it can be extracted, altered and sexually degraded at will." This sentiment reflects a growing concern among women's rights advocates regarding the implications of deepfake technology and the lack of accountability for its misuse.

South China Morning Post

Despite the rising criticism, ByteDance has not publicly responded to inquiries regarding the misuse of Doubao for creating non-consensual deepfakes. This silence raises questions about the company's responsibility in preventing the exploitation of its technology and protecting users from digital harassment.

South China Morning Post

While many countries are actively developing regulatory frameworks to address the challenges posed by AI deepfakes, the situation in China remains ambiguous. Critics argue that the absence of effective regulations allows for the proliferation of harmful content, leaving victims of digital public shaming without recourse.

South China Morning Post

• “In the shadowy corners of social media, a large-scale ‘digital public shaming’ campaign targeting ordinary women has quietly unfolded, fuelled by Doubao,” — Free Nora, Feminist Media Collective

South China Morning Post

• “For many women, a face they once believed to be uniquely their own has become raw material in a digital landscape where it can be extracted, altered and sexually degraded at will,” — Free Nora, Feminist Media Collective

South China Morning Post

As the issue of digital public shaming through deepfakes continues to escalate, there is an urgent need for regulatory measures in China to protect individuals from such abuses. The ongoing dialogue among women's rights advocates and the tech industry may shape future policies aimed at curbing the misuse of AI technologies.

South China Morning Post