The Shanghai Cyberspace Administration recently launched a special law enforcement campaign named "Abuse of AI," aiming to address violations related to generative AI technology. With the rapid development of generative AI, this technology has brought convenience to various industries, but it has also led to the emergence of abuse issues, such as AI face swapping and AI voice changing, which constitute infringement. These problems not only threaten personal privacy rights but may also damage the online ecosystem.
In this operation, law enforcement officers found that some companies failed to conduct security assessments as required by law when developing and using generative AI, and did not take necessary security protection measures, leading to the use of these technologies for face swapping, voice changing, and forging, which constitute infringement. These actions may generate illegal content, such as "doxxing," "money laundering," and generating vulgar and pornographic images.
The key focus of the special operation is to address AI abuse and promote the healthy development of emerging industries. To strengthen management, the Cyberspace Administration guided local application stores to remove 54 non-compliant generative AI applications. In addition, according to the "Regulations on Identification of AI-Generated and Synthesized Content," expert teams provided practical analysis for enterprises to resolve relevant difficulties.
In terms of penalties, the Cyberspace Administration conducted follow-up inspections on 26 generative AI service websites that had previously been required to remove functions, ensuring that the issues would not recur. For three websites that refused to make corrections, the "Interim Provisions on the Management of Generative AI Services" was applied for the first time to initiate administrative penalties. At the same time, enterprises that violated the regulations for the first time were given an opportunity to be exempt from penalties, requiring them to remove the relevant illegal functions and guiding them through the filing process.
Key Points:
🌟 54 non-compliant generative AI applications were removed, and the special operation strengthened regulation.
🔍 Three websites that refused to make corrections were subject to administrative penalties, and the relevant management provisions were applied for the first time.
🚀 Enterprise compliance awareness has significantly increased, promoting the healthy development of new technologies.
