OpenAI Bans Accounts Linked to Chinese Influence Campaigns

OpenAI has recently suspended accounts tied to Chinese operatives who allegedly used ChatGPT to conduct social media influence campaigns focused on U.S. discussions around tariffs and AI data centers.

A report mentioned that, although the banned campaign did not manage to gain much traction online, it highlights how individuals connected to China are testing AI tools to exacerbate pre-existing political and economic divides in the United States.

OpenAI disclosed that researchers have pinpointed two separate operations that used ChatGPT to generate social media content, including posts, comments, and political cartoons targeting U.S. technology policies. The first initiative, referred to internally as “Data Center Bandwagon,” produced commentary and cartoons suggesting that AI data centers were driving up electricity costs for American households. The second operation, named “Tech and Tariffs,” employed ChatGPT to craft content and cartoons that critiqued the tariff strategies of the Trump administration and the U.S.’s quest for technological dominance globally.

Ben Nimmo, a key researcher on OpenAI’s intelligence and investigations team, noted that this situation isn’t merely about an influence operation that’s controversial. “The discussion already existed. This was an influence operation by China to try to interfere with it,” he remarked.

OpenAI recognized that neither of these campaigns managed to engage the public significantly online. Still, company officials indicated that this could be the first known instance of a China-linked operation using OpenAI’s models to intrude on specific debates about AI data centers.

The attack related to data centers involved a user believed to have connections to a Chinese government contractor. This user prompted ChatGPT to create comics about power grid capacity and electricity costs, which were then shared on social media.

Another unidentified group, not clearly connected to any single entity, utilized ChatGPT to produce political cartoons portraying President Trump unfavorably regarding American technology and trade policies. One of these cartoons depicted him wearing pants covered in American flags that read “America First,” while wielding a mallet labeled “Technology Advantage” to smash a wall marked “The Future of the World.”

OpenAI framed these campaigns as early indicators of how foreign influencers are starting to use AI tools to generate content around contentious political matters in the U.S. The company’s actions to detect and ban these accounts highlight the growing obstacles AI developers must navigate in preventing their technology from being exploited for state-sponsored information warfare.

AI is not just a hot-button issue in the competition between the U.S. and China; it’s also seen as a potential tool against the American populace. Some argue, as noted in a bestselling book, that there is a pressing need to outline a strategy for harnessing AI’s advantages while steering clear of the risks highlighted in ongoing discussions.