OpenAI has developed voice-cloning technology that can replicate voices with just 15 seconds of recorded speech, but is withholding its release to the public due to concerns over misuse. The Mail has the details.
A new type of deepfake known as voice cloning has emerged in recent months, in which artificial intelligence (AI) is used to simulate your voice.
ChatGPT-maker, OpenAI, is the latest tech giant to develop voice cloning software – but it’s not releasing it to the public.
The creepy technology can replicate anyone’s voice within just 15 seconds of recorded speech.
And OpenAI has deemed it “too risky” for public use – particularly in an election year.
“We recognise that generating speech that resembles people’s voices has serious risks, which are especially top of mind in an election year,” the San Francisco company said in a statement.
OpenAI unveiled the Voice Engine technology on Friday, just over a week after filing a trademark application for the name. …
OpenAI says it plans to preview it with early testers “but not widely release this technology at this time” because of the dangers of misuse.
In New Hampshire, authorities are investigating robocalls sent to thousands of voters just before the presidential primary that featured an AI-generated voice mimicking President Joe Biden.
Worth reading in full.
To join in with the discussion please make a donation to The Daily Sceptic.
Profanity and abuse will be removed and may lead to a permanent ban.
Scary! I’ve often wondered about this possibility during phone calls to companies with recorded messages that used to say, “We may record this call for training and quality purposes”, which later became “We record all calls…”. And some phone recordings that would demand a voice response from you, trying to force you to say something, instead of pushing a numerical choice button to reach the relevant department.
I’d like to think that real humans can tell a human voice from a robot voice. I hope so.
Another creepy thing is that this OpenAI puts on a show of “concern” about the “risks” of releasing it to the public, but then why did they develop it in the first place?
Absolutely. Your last point is the kicker. Why develop voice cloning in the first place? The ways in which such technology could be weaponised is mind-boggling. Oh so here you are discussing how to assassinate the president or steal or plot etc. However, what it would mean is that recorded conversations could not be used in court to convict someone – unless there’s a way to discern the real person’s voice – so my guess is that this is not directed at us, it’s for the benefit of the really guilty. Same goes for pictures and videos since they can all be faked by AI too.
That’s a very interesting take on this, that it will benefit only the really guilty. I hope you are right that it isn’t directed at us.
As for pictures and videos, the worst in my view is the Fake AI-generated Porn used against innocent people, like the elderly Christian woman who tried to warn neighbours about a paedophile who had recently moved into their neighbourhood near a school with lots of families with young kids. He had raped his own children decades before, and years later was still dealing in child porn. In revenge he set up a Fake Porn social media account in her real name, completely destroying her reputation in the town.
Another case was a pretty young woman who was thrilled to start her new job as secretary at a local football club, but was soon harassed by lewd texts, messages and insults, resulting from a Fake Porn social media account set up by one of her ex-boyfriends who wanted to destroy her new job. She took him to court, but the judge gave him a mere £400 fine for ruining her life. Apparently anyone can set up new Fake Porn accounts impersonating a victim, even after being caught, so it’s not worth pursuing them, and victims are really helpless against it.
Now with this new AI voice-cloning, it will all get worse and worse.
I doubt the Chinese CCP will have the same scruples when it comes to this technology. Whether we like it or not, you can’t put the genie back in the bottle.
Do you think MI6 or CIA have scruples? All secret services are the same, in my opinion, and the world would probably be a far better place without them.
They closed all the bank branches and replaced them with voice ID. Whoops.
The tech’s invented. It’s out there.
Never been a better time for Blockchain. BSV Blockchain, not that BTC crap.
If I phone my bank, it uses voice recognition tech to verify a customer’s identity, a clever use of AI, but one that’s now obsolete due to this latest evolution in voice tech.
The security implications of AI are far-reaching .