AI struggles with gender and race

​People take part in the annual Gay Pride parade in support of LGBT community, in Santiago, Chile, June 22, 2019.
People take part in the annual Gay Pride parade in support of LGBT community, in Santiago, Chile, June 22, 2019.
REUTERS/Rodrigo Garrido

Generative AI keeps messing up on important issues about diversity and representation — especially when it comes to love and sex.

According to one report from The Verge, Meta’s AI image generator repeatedly refused to generate images of an Asian man with a white woman as a couple. When it finally produced one of an Asian woman and a white man, the man was significantly older than the woman.

Meanwhile, Wired found that different AI image geneators routinely represent LGBTQ individuals as having purple hair. And when you don’t specify what ethnicity they should be, these systems tend to default to showing white people.

Generative AI tools are no better than their underlying training data. If their training data is biased, say, by having disproportionate amounts of queer people with highlighter-colored hair, it will consistently represent them as such. It’s incumbent on the proprietors of these models to both improve their training data — buying or accumulating more comprehensive datasets — but, more importantly, tweaking the outputs so they are more inclusive and less stereotypical. That requires lots of testing, and consultation with real-world people from diverse backgrounds about the harms of such representation failures.

But they need to be wary of overcorrection too: Google was recently condemned for generating Black and Asian Nazi soldiers as well as Native Americans in Viking garb. AI can’t understand the complexities of these things yet — but the humans in charge need to.

More from GZERO Media

People celebrate after President Yoon Suk-yeol's impeachment was accepted, near the Constitutional Court in Seoul, South Korea, on April 4, 2025.
REUTERS/Kim Hong-ji

South Korea’s Constitutional Court on Friday voted unanimously to oust impeached President Yoon Suk-yeol over his decision to declare martial law in December. Supporters of Yoon who gathered near the presidential residence in Seoul reportedly cried out in disappointment as the court’s 8-0 decision was announced. Others cheered the ruling. The center-right leader is now the second South Korean president to be ousted.

President Donald Trump speaks to the media as he leaves the White House for a trip to Florida on April 3, 2025.
Andrew Leyden/NurPhoto via Reuters

Stocks have plummeted, layoffs have begun, and confusion has metastasized about the bizarre method the United States used to calculate its tariff formula. But Donald Trump says it’s “going very well."

African National Congress (ANC) members of parliament react after South African lawmakers passed the budget's fiscal framework in Cape Town, South Africa, April 2, 2025.
REUTERS/Esa Alexander

The second largest party in South Africa’s coalition, the business-friendly Democratic Alliance, launched a legal challenge on Thursday to block a 0.5% VAT increase in the country’s new budget, raising concerns that the fragile government could collapse.

The Israeli Air Force launched an airstrike on Thursday, targeting a building in the Mashrou Dummar area of Damascus. Israeli Defense Minister Yoav Gallant confirmed Israel's responsibility for the attack, which resulted in one fatality.
Rami Alsayed via Reuters Connect

As we wrote in February, Turkey’s president, Recep Tayyip Erdogan, has big plans for Syria. Erdogan’s government was a crucial backer of the HTS militia, an Islamist rebel group that ousted longtime Syrian strongman Bashar Assad in December, and it now wants Turkey’s military to take over some air bases on Syrian territory in exchange for Turkish training of Syria’s new army.

A man leaves the U.S. headquarters of the social media company TikTok in Culver City, California, U.S. January 17, 2025.
REUTERS/David Swanson

Remember the TikTok ban? The new deadline President Donald Trump set for the app to find an American buyer or be banned from US app stores, midnight Saturday, is rapidly approaching.

National Security Advisor Mike Waltz looks on as he sits next to US Defense Secretary Pete Hegseth in the Oval Office on March 13, 2025.

REUTERS/Evelyn Hockstein

Someone needs to take National Security Advisor Michael Waltz’s phone out of his hand.