OpenAI has decided not to release its Voice Engine tool that can generate a convincing clone of anyone's voice using just 15 seconds of recorded audio.

Deeming the tool too risky for general release, OpenAI said it was seeking to minimise the threat of damaging misinformation ahead of a year&nbsp;when about half the world will vote in elections.

<h2>The 'dangerous' voice clone tool</h2>

As per The Guardian, Voice Engine was first developed in 2022. An initial version of the tool was used for OpenAI's AI tool ChatGPT's text-to-speech feature.

However, after realising how powerful the tool is, keeping with its "cautious and informed" approach, the company has revealed its power publicly as it seeks to release the tool more widely.

Also read |&nbsp;<a href="https://www.wionews.com/trending/a-grave-step-backwards-meta-to-scrap-misinformation-monitoring-tool-crowdtangle-ahead-of-2024-us-elections-706469">'A grave step backwards': Meta to scrap misinformation monitoring tool CrowdTangle ahead of 2024 US elections</a>

"We hope to start a dialogue on the responsible deployment of synthetic voices, and how society can adapt to these new capabilities," said OpenAI in a blog post.

"Based on these conversations and the results of these small-scale tests, we will make a more informed decision about whether and how to deploy this technology at scale," it added.

<h2>Voice Engine's uses</h2>

In its blog post, OpenAI gave examples of real-world uses of the technology. This includes generating scripted voiceovers and preserving accents in translations.

&nbsp; 
OpenAI said it was opting to "preview but not widely release this technology at this time," in order "to bolster societal resilience against the challenges brought by ever more convincing generative models."

It added that it is encouraging "steps like phasing out voice-based authentication as a security measure for accessing bank accounts and other sensitive information."

Also read |&nbsp;<a href="https://www.wionews.com/science/new-study-reveals-ais-hidden-bias-in-screening-depression-in-black-people-705484">New study reveals AI's hidden bias in screening depression in Black people</a>

The company also called for the exploration of "policies to protect the use of individuals' voices in AI," and "educating the public in understanding the capabilities and limitations of AI technologies, including the possibility of deceptive AI content."

OpenAI said that the generated audio will be watermarked so that its origins can be traced.&nbsp;

"Our terms with these (current) partners require explicit and informed consent from the original speaker, and we don’t allow developers to build ways for individual users to create their own voices."

While OpenAI's Voice Engine stands out for its technical simplicity and efficiency, competitors offering similar tools are already available to the public. Companies like ElevenLabs can generate complete voice clones with just a few minutes of audio.&nbsp;

(With inputs from agencies)

OpenAI has decided not to release its Voice Engine tool that can generate a convincing clone of anyone's voice using just 15 seconds of recorded audio. Deeming the tool too risky for general release, OpenAI said it was seeking to minimise the threat of damaging misinformation ahead of a year when about half the world will vote in elections.

OpenAI has decided not to release its Voice Engine tool that can generate a convincing clone of anyone's voice using just 15 seconds of recorded audio. Deeming the tool too risky for general release, OpenAI said it was seeking to minimise the threat of damaging misinformation ahead of a year when about half the world will vote in elections. The 'dangerous' voice clone tool As per The Guardian, Voice Engine was first developed in 2022. An initial version of the tool was used for OpenAI's AI tool ChatGPT's text-to-speech feature. However, after realising how powerful the tool is, keeping with its "cautious and informed" approach, the company has revealed its power publicly as it seeks to release the tool more widely. Also read | 'A grave step backwards': Meta to scrap misinformation monitoring tool CrowdTangle ahead of 2024 US elections "We hope to start a dialogue on the responsible deployment of synthetic voices, and how society can adapt to these new capabilities," said OpenAI in a blog post. "Based on these conversations and the results of these small-scale tests, we will make a more informed decision about whether and how to deploy this technology at scale," it added. Voice Engine's uses In its blog post, OpenAI gave examples of real-world uses of the technology. This includes generating scripted voiceovers and preserving accents in translations. OpenAI said it was opting to "preview but not widely release this technology at this time," in order "to bolster societal resilience against the challenges brought by ever more convincing generative models." It added that it is encouraging "steps like phasing out voice-based authentication as a security measure for accessing bank accounts and other sensitive information." Also read | New study reveals AI's hidden bias in screening depression in Black people The company also called for the exploration of "policies to protect the use of individuals' voices in AI," and "educating the public in understanding the capabilities and limitations of AI technologies, including the possibility of deceptive AI content." OpenAI said that the generated audio will be watermarked so that its origins can be traced. "Our terms with these (current) partners require explicit and informed consent from the original speaker, and we don’t allow developers to build ways for individual users to create their own voices." While OpenAI's Voice Engine stands out for its technical simplicity and efficiency, competitors offering similar tools are already available to the public. Companies like ElevenLabs can generate complete voice clones with just a few minutes of audio. (With inputs from agencies)

OpenAI pumps the brakes on its voice cloning tool over misinformation risks

voice-engine

Voice Engine, News on Voice Engine, stories on Voice Engine, articles on Voice Engine, Voice Engine stories at Wion, Voice Engine news, Voice Engine latest news

voice engine

OpenAI pumps the brakes on its voice cloning tool over misinformation risks