OpenAI is risk-testing Voice Engine, but the risks are clear

- YouTube
Marietje Schaake, International Policy Fellow, Stanford Human-Centered Artificial Intelligence, and former European Parliamentarian, co-hosts GZERO AI, our new weekly video series intended to help you keep up and make sense of the latest news on the AI revolution. In this episode, she says that while OpenAI is testing its new Voice Engine model to identify its risks, we've already experienced the clear dangers of voice impersonation technology. What we need is a more independent assessment of these new technologies applying equally to companies who want to tread carefully and those who want to race ahead in developing and deploying the technology.

About a year ago, I was part of a small meeting where I was asked to read a paragraph, sort of random text to me, it seemed. But before I knew it, I heard my own voice very convincingly, saying things through the speakers of the conference room that I had never said and would never say.

And it was really, you know, a sort of goosebump moment because I realized that generative AI used for voice was already very convincing. And that was a prototype of the voice engine, which is now being reported by the New York Times as having been this new product by OpenAi that the company is choosing to only release to a limited set of users as it's still testing the risky uses.

And I don't think this testing with a limited set of users is needed to understand the risks. We've already heard of fraudulent robocalls impersonating President Biden. We've heard of criminals trying to deceive parents, for example, with voice messages sounding like their children who are in trouble and asking for the parent to send money, which then, of course, benefits the criminal group, not their children.

So the risks of using voice impersonation are clear. Of course, companies will also point to opportunities of helping people who may have lost their voice through illness or disability, which I think is an important opportunity to explore. But we cannot be naive about the risks. And so in response to the political robocalls, the Federal Communications Commission at least drew a line and said that AI cannot be used for these. So there are some kind of restriction. But all in all, we need to see more independent assessment of these new technologies, a level playing field for all companies, not just those who want to choose to pace the release of their new models, but also those who want to race ahead. Because sooner or later, one or the other company will and we will all potentially be confronted with this widely accessible, voice generating artificial intelligence opportunity.

So it is a tricky moment when we see the race to bring to market and the rapid development of these technologies, which also incur a lot of risk and harm as an ongoing dynamic in the AI space. And so I hope that as there are discussions around regulation and guardrails happening around the world, that the full spectrum of use cases that we know and can anticipate will be on the table with the aim of keeping people free from crime, our democracy safe, while making sure that if there is a benefit for people in minority disabled communities, that they can benefit from this technology as well.

More from GZERO Media

A ''Buy Canadian Instead'' sign is displayed on top of bottles, hanging above another sign that reads "American Whiskey," at a B.C. Liquor Store in Vancouver, British Columbia, Canada.
REUTERS/Chris Helgren//File Photo

Even before Trump’s tariff announcement on Wednesday, Canadian consumers were engaged in a grassroots trade war aimed at hurting American companies. The “Buy Canadian” movement is having a moment.

Jess Frampton

Pierre Poilievre’s support of the trucker convoy in 2022 helped him win the Conservative leadership, and ever since, he has stuck with the people whose fury fueled his rise. But that same approach is hurting him ahead of this month's federal election.

Global energy demand is growing, and meeting it requires all forms of energy — oil, gas, and renewables — working together. Enbridge is investing in all of the above. Billions in renewables. Decades of reliable oil and gas infrastructure. Because keeping the world moving isn’t about picking one solution — it’s about using them all. The bottom line: The energy future is evolving. We’re ready. Learn more here.

- YouTube

Do you think the Signal controversy in the US will have an impact on the transatlantic relationship? What impact do you think the Turkish protests and instability will have on Turkish relationships with its European allies? Carl Bildt, former prime minister of Sweden and co-chair of the European Council on Foreign Relations, shares his perspective on European politics from Stockholm, Sweden.

U.S. President Donald Trump delivers remarks on tariffs in the Rose Garden at the White House in Washington, D.C., U.S., April 2, 2025.
REUTERS/Carlos Barria

During a speech in the White House Rose Garden on Wednesday, Donald Trump announced a 10% across-the-board tariff on US imports, with higher rates for countries that have a larger trade surplus with the United States – to the tune of 20% for the EU, 54% for China, and 46% for Vietnam, to name a few of the hardest-hit. Trump also confirmed that he’s imposing 25% levies on foreign-made cars and parts.

Palestinians travel in vehicles between the northern and southern Gaza Strip along the Rashid Road on April 2, 2025.

Majdi Fathi/NurPhoto via Reuters

Israeli PM Benjamin Netanyahu said Wednesday that Israel was seizing more territory in Gaza to “divide up” the besieged enclave. He spoke as Israeli forces increased the intensity of their assault on Hamas in Gaza, which resumed two weeks ago after phase one of the ceasefire agreed to in January ended.

Vice President JD Vance and his wife, Usha Vance, tour the US military's Pituffik Space Base in Greenland on March 28, 2025.
JIM WATSON/Pool via REUTERS

How much would it cost for the United States to maintain Greenland as its territory? And what are the revenue possibilities from the Arctic island’s natural resources? Those are two questions the White House is reportedly looking into in the surest sign yet that Trump’s interest in Greenland is genuine.