About

Why OpenAI won’t release its new voice cloning tool this year

Share
"It's important that people around the world understand where this technology is headed, whether we ultimately deploy this technology ourselves or not," OpenAI said.
OpenAI voice cloning tool

ChatGPT maker OpenAI has said it won’t release its new voice cloning tool this year because of the risk it will be misused in elections around the world.

OpenAI’s voice cloning tool was unveiled this week alongside a statement that it doesn’t intend to make it publicly available until its dangers are understood

About OpenAI’s voice cloning tool

Test users have uploaded a 15-second recording of a person’s voice, along with a paragraph of text. The tool, called ‘Voice Engine’ then reads the text with a voice resembling the original speaker.

It can also recreate a voice in a different language, meaning if you provide a sample in English, it can recreate the voice in French, or a number of other languages.

Plans

The tool isn’t publicly available and has no release date.

OpenAI said the potential for “misuse” is currently too large, and it’s still deciding “whether and how to deploy this technology at scale”.

Risks

OpenAI identified several risks. One is the possibility that deploying this tool during a year with several global elections could mean the voices of politicians and public figures are used without their consent for non-approved purposes.

It’s also concerned that the tool could be used to crack banking security and other systems protecting sensitive information.

The company said it’s working on a verification feature where the original speaker knows their voice is being added to the service, to be implemented before public release.

“It’s important that people around the world understand where this technology is headed, whether we ultimately deploy this technology ourselves or not,” OpenAI said.

Become smarter in three minutes

Get the daily email that makes reading the news actually enjoyable. Stay informed, for free.

Be the smart friend in your group chat

Join thousands of young Aussies and get our 5 min daily newsletter on what matters in your world.

It’s easy. It’s trustworthy. It’s free.