Microsoft warned that state-backed Chinese cyber groups – with assistance from North Korean actors – “are likely to target” the presidential and legislative elections in countries such as the US, South Korea, and India this year. Their primary tactic is projected to be the creation and dissemination on social media of AI-generated content skewed to “benefit their positions” in these races.

“While the impact of such content in swaying audiences remains low, China’s increasing experimentation in augmenting memes, videos, and audio will continue – and may prove effective down the line,” Microsoft cautioned in the report released Friday.

The company cited China’s recent “dry run” utilising AI-synthesised disinformation during Taiwan’s January presidential election as a harbinger of this emerging threat. Microsoft assessed that a pro-Beijing group known as Storm 1376 or Spamouflage Dragon made the first documented attempt by a state actor to influence a foreign vote using AI-manufactured content.

Tactics deployed by the Chinese-backed operatives included posting fake audio clips likely “generated by AI” that depicted a former presidential candidate endorsing a rival, as well as AI-generated memes leveling unfounded corruption allegations against the ultimately victorious pro-sovereignty candidate William Lai. The group also created AI-rendered “news anchors” to broadcast disinformation about Lai’s personal life.

“As populations in India, South Korea, and the United States head to the polls, we are likely to see Chinese cyber and influence actors, and to some extent North Korean cyber actors, work toward targeting these elections,” the Microsoft report stated.

The company added that Chinese groups are already attempting to map divisive issues and voting blocs in the US through orchestrated social media campaigns, potentially “to gather intelligence and precision on key voting demographics ahead of the US Presidential election.”

While flagging the risk, Microsoft acknowledged that AI-enabled disinformation has so far achieved limited success in shaping public opinion globally. But it warned that Beijing’s growing investment and increasing sophistication with the technology poses an escalating threat to the integrity of democratic elections worldwide.

(Photo by Element5 Digital)

See also: How to safeguard your business from AI-generated deepfakes

Want to learn more about AI and big data from industry leaders? Check out AI & Big Data Expo taking place in Amsterdam, California, and London. The comprehensive event is co-located with other leading events including BlockX, Digital Transformation Week, and Cyber Security & Cloud Expo.

Explore other upcoming enterprise technology events and webinars powered by TechForge here.

The post Microsoft: China plans to disrupt elections with AI-generated disinformation appeared first on AI News.

Speaking to The Times, Cleverly emphasised the rapid advancement of AI technology and its potential to undermine elections not just in the UK but globally. He warned that malign actors working on behalf of nations like Russia and Iran could generate thousands of highly realistic deepfake images and videos to disrupt the democratic process.

“Increasingly today the battle of ideas and policies takes place in the ever-changing and expanding digital sphere,” Cleverly told the newspaper. “The era of deepfake and AI-generated content to mislead and disrupt is already in play.”

The Home Secretary plans to urge collective action from Silicon Valley giants like Google, Meta, Apple, and YouTube when he meets with them this week. His aim is to implement “rules, transparency, and safeguards” to protect democracy from deepfake disinformation.

Cleverly’s warnings come after a series of deepfake audios imitating Labour leader Keir Starmer and London Mayor Sadiq Khan circulated online last year. Fake BBC News videos purporting to examine PM Rishi Sunak’s finances have also surfaced.

The tech meetings follow a recent pact signed by major AI companies like Adobe, Amazon, Google, and Microsoft during the Munich Security Conference to take “reasonable precautions” against disruptions caused by deepfake content during elections worldwide.

As concerns over the proliferation of deepfakes continue to grow, the world must confront the challenges they pose in shaping public discourse and potentially influencing electoral outcomes.

(Image Credit: Lauren Hurley / No 10 Downing Street under OGL 3 license)

See also: Stability AI previews Stable Diffusion 3 text-to-image model

Want to learn more about AI and big data from industry leaders? Check out AI & Big Data Expo taking place in Amsterdam, California, and London. The comprehensive event is co-located with other leading events including BlockX, Digital Transformation Week, and Cyber Security & Cloud Expo.

Explore other upcoming enterprise technology events and webinars powered by TechForge here.

The post UK Home Secretary sounds alarm over deepfakes ahead of elections appeared first on AI News.