Washington, United States
OpenAI has reported multiple instances where its AI models have been misused to create fake content, such as lengthy articles and social media posts, with the intent to influence elections, according to a report published on Wednesday (Oct 9).
Cybercriminals exploiting AI technology
Cybercriminals are using AI models like ChatGPT to produce convincing, large-scale text. This allows bad actors to create false news stories, online posts, and even fraudulent election materials that could mislead the public.
The report, which was released on Wednesday, revealed that OpenAI’s models have been exploited to generate fake content aimed at swaying elections. These AI-generated messages often imitate legitimate news sources, making it harder for people to distinguish between real and fabricated information.
Recent cases of AI misuse neutralised by OpenAI
The company has neutralised over 20 such attempts this year alone. One notable incident in August involved ChatGPT accounts used to create articles about the U.S. elections. In July, several accounts from Rwanda were also banned after they were found generating election-related posts for social media platform X.
Also read: ‘It needs to go’: Tim Walz calls for scrapping of electoral college system
However, OpenAI noted that none of these efforts to influence elections gained significant traction or attracted lasting audiences.
Growing concerns over AI and fake content in elections
Concerns are mounting over the use of AI tools and social media platforms for spreading false election-related content, particularly as the U.S. prepares for its upcoming presidential elections. The U.S. Department of Homeland Security has warned of an increasing threat from Russia, Iran, and China, which may use AI to spread fake or divisive information ahead of the November 5 elections.
OpenAI recently strengthened its standing as one of the most valuable private companies globally, following a $6.6 billion fundraising round last week. Since its launch in November 2022, ChatGPT has attracted 250 million active users weekly.
(With inputs from agencies)