AI's existential risks: Why Yoshua Bengio is warning the world

- YouTube

In this episode of GZERO AI, Taylor Owen, host of the Machines Like Us podcast, reflects on the growing excitement around artificial intelligence. At a recent AI conference he attended, Owen observes that while startups and officials emphasized AI's economic potential, prominent AI researcher Yoshua Bengio voiced serious concerns about its existential risks. Bengio, who's crucial to the development of the technology, stresses the importance of cautious public policy, warning that current AI research tends to prioritize power over safety.

A couple of weeks ago, I was at this big AI conference in Montreal called All In. It was all a bit over the top. There were smoke machines, loud music, and food trucks. It's clear that AI has come a long way from the quiet labs it was developed in. I'm still skeptical of some of the hype around AI, but there's just no question we're in a moment of great enthusiasm. There were dozens of startup founders there talking about how AI was going to transform this industry or that, and government officials promising that AI was going to supercharge our economy.

And then there was Yoshua Bengio. Bengio is widely considered one of the world's most influential computer scientists. In 2018, he and two colleagues won the Turing Award, the Nobel Prize of Computing for their work on deep learning, which forms the foundation of much of our current AI models. In 2022, he was the most cited computer scientist in the world. It's really safe to say that AI, as we currently know it, might not exist without Yoshua Bengio.

And I recently got the chance to talk to Bengio for my podcast, "Machines Like Us." And I wanted to find out what he thinks about AI now, about the current moment we're in, and I learned three really interesting things. First, Bengio's had an epiphany of sorts, as been widely talked about in the media. Bengio now believes that, left unchecked, AI has the potential to pose an existential threat to humanity. And so he's asking us, even if there's a small chance of this, why not proceed with tremendous caution?

Second, he actually thinks that the divide over this existential risk, which seems to exist in the scientific community, is being overplayed. Him and Meta's Yann LeCun, for example, who he won the Turing Prize with, differ on the timeframe of this risk and the ability of industry to contain it. But Bengio argues they agree on the possibility of it. And in his mind it's this possibility which actually should create clarity in our public policy. Without certainty over risk, he thinks the precautionary principle should lead, particularly when the risk is so potentially grave.

Third, and really interestingly, he's concerned about the incentives being prioritized in this moment of AI commercialization. This extends from executives like LeCun potentially downplaying risk and overstating industry's ability to contain it, right down to the academic research labs where a majority of the work is currently focused on making AI more powerful, not safer. This is a real warning that I think we need to heed. There's just no doubt that Yoshua Bengio's research contributed greatly to the current moment of AI we're in, but I sure hope his work on risk and safety shapes the next. I'm Taylor Owen and thanks for watching.

More from GZERO Media

ISKCON (International Society for Krishna Consciousness) activists hold placards as they protest demanding the release of Hindu priest Chinmoy Krishna Das Prabhu, who was arrested in Bangladesh, in Kolkata, India, 29 November 2024. Chinmoy Krishna Das Prabhu, the spokesperson for the Bangladesh Sammilita Sanatani Jagran Jote was arrested by the Dhaka Metropolitan Police on November 25, accused of disrespecting Bangladesh's national flag during a rally.
Matrix Images / Rupak De Chowdhuri via Reuters

Anger in India over mistreatment of Bangladesh’s Hindu minority could spark a trade war.

People use mobile phones during a blackout after Hurricane Rafael knocked out the country's electrical grid, in Havana, in November. On Tuesday, the island suffered yet another blackout when a major power plant failed.
REUTERS/Norlys Perez

The crisis-wracked island has been hit with three power failures in the past two months -- and things may get worse still.

South Korean protestors calling for the dismissal and impeachment of South Korean President Yoon Suk Yeol outside the National Assembly in Seoul, South Korea, on December 4, 2024. South Korean President Yoon Suk Yeol briefly declared martial law on December 3, 2024, citing threats to democracy from opposition lawmakers he labeled as pro-North Korea. The decree, which restricted political activities, media, and strikes, was quickly overturned by the National Assembly. The event highlights rising tensions and Yoon’s declining authority following significant opposition victories in recent elections.
Matrix Images / Kwak Kyung-Keun

Soon after South Korean President Yoon Suk Yeol lifted his imposition of martial law early Wednesday, opposition parties filed an impeachment bill against him in the National Assembly.

French Prime Minister Michel Barnier reacts during the result of the vote on the first motion of no-confidence against the French government, in Paris, France, on Dec. 4, 2024.
REUTERS/Sarah Meyssonnier

For the first time since 1962, the National Assembly, France’s lower (and more powerful) house of parliament, has voted to oust a government. Prime Minister Michel Barnier is out.

- YouTube

What's happening in France? Is there any way for the European Union and other Europeans to influence the course of events in Georgia? Carl Bildt, former prime minister of Sweden and co-chair of the European Council on Foreign Relations, shares his perspective on European politics from Parma, Italy.

Syrian rebel in Aleppo.
Reuters

The flareup of Syria’s civil war continues to expand, as the Turkey-adjacent Islamist rebels who took the city of Aleppo from Bashar Assad’s regime over the weekend are now advancing southward, setting their sights on the strategic, and highly symbolic, city of Hama.