AI's existential risks: Why Yoshua Bengio is warning the world

- YouTube

In this episode of GZERO AI, Taylor Owen, host of the Machines Like Us podcast, reflects on the growing excitement around artificial intelligence. At a recent AI conference he attended, Owen observes that while startups and officials emphasized AI's economic potential, prominent AI researcher Yoshua Bengio voiced serious concerns about its existential risks. Bengio, who's crucial to the development of the technology, stresses the importance of cautious public policy, warning that current AI research tends to prioritize power over safety.

A couple of weeks ago, I was at this big AI conference in Montreal called All In. It was all a bit over the top. There were smoke machines, loud music, and food trucks. It's clear that AI has come a long way from the quiet labs it was developed in. I'm still skeptical of some of the hype around AI, but there's just no question we're in a moment of great enthusiasm. There were dozens of startup founders there talking about how AI was going to transform this industry or that, and government officials promising that AI was going to supercharge our economy.

And then there was Yoshua Bengio. Bengio is widely considered one of the world's most influential computer scientists. In 2018, he and two colleagues won the Turing Award, the Nobel Prize of Computing for their work on deep learning, which forms the foundation of much of our current AI models. In 2022, he was the most cited computer scientist in the world. It's really safe to say that AI, as we currently know it, might not exist without Yoshua Bengio.

And I recently got the chance to talk to Bengio for my podcast, "Machines Like Us." And I wanted to find out what he thinks about AI now, about the current moment we're in, and I learned three really interesting things. First, Bengio's had an epiphany of sorts, as been widely talked about in the media. Bengio now believes that, left unchecked, AI has the potential to pose an existential threat to humanity. And so he's asking us, even if there's a small chance of this, why not proceed with tremendous caution?

Second, he actually thinks that the divide over this existential risk, which seems to exist in the scientific community, is being overplayed. Him and Meta's Yann LeCun, for example, who he won the Turing Prize with, differ on the timeframe of this risk and the ability of industry to contain it. But Bengio argues they agree on the possibility of it. And in his mind it's this possibility which actually should create clarity in our public policy. Without certainty over risk, he thinks the precautionary principle should lead, particularly when the risk is so potentially grave.

Third, and really interestingly, he's concerned about the incentives being prioritized in this moment of AI commercialization. This extends from executives like LeCun potentially downplaying risk and overstating industry's ability to contain it, right down to the academic research labs where a majority of the work is currently focused on making AI more powerful, not safer. This is a real warning that I think we need to heed. There's just no doubt that Yoshua Bengio's research contributed greatly to the current moment of AI we're in, but I sure hope his work on risk and safety shapes the next. I'm Taylor Owen and thanks for watching.

More from GZERO Media

Last week, world leaders gathered in New York City for the 79th UN General Assembly to discuss progress toward the Sustainable Development Goals. Microsoft Vice Chair and President Brad Smith emphasized the role of AI in accelerating this progress, highlighting the importance of innovation, technology, and partnerships. Read our latest newsletter for key takeaways from a week of productive conversations and innovative ideas.

Walmart is fueling American jobs and strengthening communities by investing in local businesses. Athletic Brewing landed a deal with Walmart in 2021. Since then, co-founders Bill Shufelt and John Walker have hired more than 200 employees and built a150,000-square-foot brewery in Milford, CT. Athletic Brewing is one of many US-based suppliers working with Walmart. By 2030, the retailer is estimated to support the creation of over 750,000 US jobs by investing an additional $350 billion in products made, grown, or assembled in America. Learn more about Walmart’s commitment to US manufacturing.

- YouTube

Will there be political fallout in the aftermath of Hurricane Helene? What were the big takeaways from President Xi's speech celebrating the 75th anniversary of the People's Republic of China? As Japan's new Prime Minister assembles his government, how will he set himself apart from former PM Kishida? Ian Bremmer shares his insights on global politics this week on World In :60.

FILE PHOTO: California Governor Gavin Newsom (D) reacts as he speaks to the members of the press on the day of the first presidential debate hosted by CNN in Atlanta, Georgia, U.S., June 27, 2024.
REUTERS/Marco Bello/File Photo

California Gov. Gavin Newsom on Sunday vetoed the Safe and Secure Innovation for Frontier Artificial Intelligence Models Act, or SB 1047, the AI safety bill passed by the state’s legislature in August.

Meta CEO Mark Zuckerberg presents Meta AI Translation, as he makes a keynote speech at the Meta Connect annual event, at the company's headquarters in Menlo Park, California, U.S. September 25, 2024.
REUTERS/Manuel Orbegozo

If you’ve been on Facebook recently, you might have seen friends or even celebrities posting about Meta’s artificial intelligence.

U.S. Sen. Ben Cardin addresses a press conference at U.S. Capitol on the future of the Chesapeake Bay
TNS/ABACA via Reuters Connect

US Sen. Ben Cardin, a Democrat from Maryland, recently joined a videoconference with a top Ukrainian official. The only problem? It was a deepfake.

EDMONTON, CANADA - APRIL 20: An image of a woman holding a cell phone in front of a OpenAI logo displayed on a computer screen, on April 20, 2024, in Edmonton, Canada.
Artur Widak via Reuters Connect

Big changes are coming to OpenAI.