AI struggles with gender and race

​People take part in the annual Gay Pride parade in support of LGBT community, in Santiago, Chile, June 22, 2019.
People take part in the annual Gay Pride parade in support of LGBT community, in Santiago, Chile, June 22, 2019.
REUTERS/Rodrigo Garrido

Generative AI keeps messing up on important issues about diversity and representation — especially when it comes to love and sex.

According to one report from The Verge, Meta’s AI image generator repeatedly refused to generate images of an Asian man with a white woman as a couple. When it finally produced one of an Asian woman and a white man, the man was significantly older than the woman.

Meanwhile, Wired found that different AI image geneators routinely represent LGBTQ individuals as having purple hair. And when you don’t specify what ethnicity they should be, these systems tend to default to showing white people.

Generative AI tools are no better than their underlying training data. If their training data is biased, say, by having disproportionate amounts of queer people with highlighter-colored hair, it will consistently represent them as such. It’s incumbent on the proprietors of these models to both improve their training data — buying or accumulating more comprehensive datasets — but, more importantly, tweaking the outputs so they are more inclusive and less stereotypical. That requires lots of testing, and consultation with real-world people from diverse backgrounds about the harms of such representation failures.

But they need to be wary of overcorrection too: Google was recently condemned for generating Black and Asian Nazi soldiers as well as Native Americans in Viking garb. AI can’t understand the complexities of these things yet — but the humans in charge need to.

More from GZERO Media

Malawi soldiers part of the Southern African Development Community (SADC) military mission for eastern Congo, wait for the ceremony to repatriate the two bodies of South African soldiers killed in the ongoing war between M23 rebels and the Congolese army in Goma, North Kivu province of the Democratic Republic of Congo February 20, 2024.
REUTERS/Arlette Bashizi

Fighters from the M23 rebel group in northeastern Congo have been targeting civilians in violation of a July ceasefire agreement, according to the Southern African Development Community, whose peacekeeping mandate was extended by a year on Wednesday.

Ari Winkleman

Donald Trump has promised a laundry list of things he will accomplish “on Day 1” in office. To name a few, he has vowed to immediately begin a mass deportation of immigrants, streamline the federal government, pardon Jan. 6 rioters, and roll back the Biden administration’s education and climate policies.

Ambassador Robert Wood of the US raises his hand to vote against the ceasefire resolution at the United Nations Security Council, on November 20, 2024.
Lev Radin/Sipa USA, via Reuters
- YouTube

Ukraine has launched US-made long-range missiles into Russia for the first time. Will this change the course of the war? How likely will Trump be able to carry out mass deportations when he's in office? Will there be political fallout from Hong Kong's decision to jail pro-democracy activists? Ian Bremmer shares his insights on global politics this week on World In :60.

A man rushes past members of security forces during clashes between gangs and security forces, in Port-au-Prince, Haiti November 11, 2024.
REUTERS/Marckinson Pierre

The UN Humanitarian Air Service is scheduled to restart flights to Haiti on Wednesday, a week after several planes attempting to land at Port-au-Prince airport came under small arms fire.