China’s AI-Driven Disinformation Campaigns Exposed by OpenAI

OpenAI has uncovered a large-scale Chinese government-backed influence operation utilizing artificial intelligence to target dissidents abroad, revealing a sophisticated network of online harassment, and disinformation. The operation, inadvertently exposed by a Chinese official using ChatGPT to document activities, highlights the growing threat of AI-powered influence operations and raises concerns about the dual-use potential of the technology.

The Accidental Exposure

The operation came to light in February 2026 when a Chinese law enforcement official used ChatGPT as a digital diary to log details of covert intimidation tactics against overseas critics of the Chinese Communist Party (CCP) OpenAI. This individual treated the AI chatbot as a personal journal, detailing plans for suppression activities. OpenAI has since banned the account Nikkei Asia.

Tactics Employed by the Network

The operation involved hundreds of operatives managing thousands of fake online accounts across various social media platforms. Tactics included:

• Impersonation: Posing as U.S. Immigration officials to threaten dissidents with deportation based on fabricated legal violations USA Herald.
• Document Forgery: Creating fake court documents demanding the removal of dissident’s social media accounts USA Herald.
• Disinformation: Fabricating obituaries and spreading false rumors of death about prominent Chinese dissidents USA Herald.
• Targeted Smear Campaigns: Attempting to discredit political figures, such as Japanese Prime Minister Sanae Takaichi, by manipulating online narratives Nikkei Asia and The Register.

Beyond China: Other Malicious AI Use Cases

OpenAI’s report also highlighted other instances of malicious AI use. A network in Cambodia used AI to create a fake dating agency, targeting young men in Indonesia with romance scams. A Russia-linked content farm utilized ChatGPT to generate and translate social media content, attempting to amplify its reach OpenAI.

AI’s Role and Limitations

While AI-generated content was used in these campaigns, OpenAI found that it wasn’t always the decisive factor in their success. Targeted advertising and established social media accounts often played a more significant role. This underscores the importance of understanding the tactics and behaviors of threat actors, rather than solely focusing on the content they produce OpenAI.

The Broader Context of AI and Security

These revelations come as financial institutions are increasingly deploying AI, machine learning, and advanced behavioral analytics to combat rising fraud and financial crime OpenAI. The incidents highlight the need for robust AI ethics and governance frameworks to counter the misuse of AI for malicious purposes.